00000001:02000400:2.0F:1789175268.815987:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789175290.644001:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789175292.816847:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 775 MB/s 00000001:01000000:2.0:1789175293.069490:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 517 MB/s 00000001:01000000:1.0:1789175293.322373:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2521 MB/s 00000020:02000000:1.0:1789175294.299991:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g7c2b8e4 00000400:02000000:0.0F:1789175295.360424:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.118@tcp [8/256/0/180] 00008000:02000000:3.0:1789175299.103428:0:3438:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789175344.776629:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789175353.665398:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789175353.665405:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789175353.665622:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003f81e0fc 00000080:02000400:3.0:1789175353.665635:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789175353.675705:0:5818:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789175353.675721:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789175353.679441:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f76cc6b3) 00000020:00000080:0.0:1789175353.679559:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789175353.735730:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789175353.736108:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789175353.775228:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789175353.775268:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789175353.775289:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789175353.775386:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789175353.775416:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789175353.783214:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789175353.783232:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789175353.783275:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c162fc 00000020:01000004:2.0:1789175353.783286:0:5818:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789175353.783291:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789175353.783298:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003f81e0fc from MGS 00000020:01000004:2.0:1789175353.783303:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789175353.783325:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000029fe83ae) 00000020:00000080:2.0:1789175353.783389:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789175353.783485:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003f81e0fc from MGS, refs=2 00080000:01000000:2.0:1789175353.783490:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789175353.783494:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c1630a 00000100:00100000:2.0:1789175353.783613:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789175353.783822:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789175353.783828:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789175353.788154:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789175353.788166:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789175353.790634:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789175353.790899:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789175353.790905:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789175353.791716:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789175353.791725:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789175353.796327:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789175353.796388:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789175353.797141:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175353.797145:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175353.797146:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175353.798040:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175353.798043:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175353.798045:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175353.798714:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789175353.806362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789175354.048712:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3123 MB/s 00000001:01000000:0.0:1789175354.298503:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3707 MB/s 00000001:01000000:0.0:1789175354.548758:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 823 MB/s 00000001:01000000:2.0:1789175354.802121:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 573 MB/s 00080000:10000000:3.0:1789175354.824995:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789175354.849741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789175354.851963:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789175354.852001:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789175354.852004:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789175354.853004:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789175354.853068:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789175354.853107:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789175354.853324:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789175354.853388:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789175354.853971:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789175354.854146:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789175354.854153:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789175354.859235:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789175354.859253:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789175354.861978:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789175354.861994:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789175354.862854:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789175354.862875:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:1.0:1789175354.862877:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789175354.862925:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:1.0:1789175354.862947:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (000000005fb71911) 00000020:00000080:1.0:1789175354.862967:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789175354.863060:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000029587547@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1789175354.863255:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:1.0:1789175354.863262:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789175354.863903:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789175354.867676:0:5835:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789175354.867727:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid e50b439a-f3a6-4419-9d6a-3b18255dcdb8) 00000020:00000080:2.0:1789175354.867758:0:5818:0:(genops.c:1385:class_connect()) connect: client e50b439a-f3a6-4419-9d6a-3b18255dcdb8, cookie 0x1112cdeac4c16318 00000100:00080000:2.0:1789175354.869721:0:5818:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175354.869736:0:5818:0:(import.c:665:import_select_connection()) MGC192.168.201.118@tcp: import 0000000029587547 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175354.869792:0:5818:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eda6f00e x1876086274130048/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789175354.869827:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS 00000020:01000004:2.0:1789175354.869854:0:5818:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789175354.869863:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789175354.869879:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000041b6e5f4) 00000020:00000080:2.0:1789175354.869899:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789175354.870639:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eda6f00e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274130048:0@lo:250: 00000100:00100000:0.0:1789175354.870746:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175354.870831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130048 00000100:00100000:0.0:1789175354.870838:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130048 00000100:00100000:0.0:1789175354.870869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175354.870876:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a1376c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3303:x1876086274130048:12345-0@lo:250: 00010000:00080000:0.0:1789175354.870902:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e50b439a-f3a6-4419-9d6a-3b18255dcdb8@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:0.0:1789175354.870938:0:5832:0:(genops.c:1385:class_connect()) connect: client e50b439a-f3a6-4419-9d6a-3b18255dcdb8, cookie 0x1112cdeac4c16326 00000100:00080000:0.0:1789175354.871060:0:5832:0:(import.c:65:import_set_state_nolock()) 00000000f216465c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175354.871108:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a1376c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:3303:x1876086274130048:12345-0@lo:250: Request processed in 231us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175354.871116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175354.871158:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789175354.871165:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:0.0:1789175354.871171:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789175354.871181:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789175354.871185:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000029587547 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789175354.871187:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789175354.871190:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789175354.871194:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eda6f00e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274130048:0@lo:250: 00000100:00100000:2.0:1789175354.889391:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175354.889722:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789175354.889727:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789175354.895949:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789175354.895962:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789175354.905942:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789175354.905965:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789175354.908066:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175354.908274:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789175354.908280:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789175354.914209:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789175354.914222:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789175354.945061:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175354.945287:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789175354.945294:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789175354.948602:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789175354.948619:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789175354.949903:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175354.950238:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789175354.950244:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789175354.951197:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789175354.951205:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789175354.952104:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175354.952306:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789175354.952312:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789175354.954145:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789175354.954158:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789175354.966557:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175354.966781:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789175354.966789:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789175354.967735:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789175354.967744:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789175354.997639:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175355.000066:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789175355.000081:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789175355.008284:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789175355.008308:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789175355.014692:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789175355.014710:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789175355.020633:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789175355.020713:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789175355.020720:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789175355.020948:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789175355.021003:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789175355.021008:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789175355.021009:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.021010:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.021012:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175355.021018:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.021019:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.021020:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.021022:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.021023:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175355.021024:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175355.021025:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.021026:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175355.021029:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789175355.021031:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789175355.021032:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.021033:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.021033:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175355.021034:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.021035:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.021036:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.021037:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.021037:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175355.021038:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175355.021039:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.021040:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175355.021083:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789175355.021106:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130176:0@lo:253: 00000100:00100000:3.0:1789175355.021197:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.021390:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000373bdd93 going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.021655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130176 00000100:00100000:2.0:1789175355.021663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130176 00000100:00100000:2.0:1789175355.021744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175355.021753:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004257f634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:5818:x1876086274130176:12345-0@lo:253: 20000000:01000000:2.0:1789175355.021809:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789175355.021812:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789175355.022247:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789175355.022324:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789175355.022748:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175355.024137:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789175355.024760:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789175355.024841:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789175355.024848:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789175355.024851:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789175355.024873:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789175355.025295:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175355.025924:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789175355.025941:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789175355.026017:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789175355.026068:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789175355.026116:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789175355.026211:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789175355.026219:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789175355.026257:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789175355.026265:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789175355.026292:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789175355.026298:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789175355.026320:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789175355.026400:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789175355.026432:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789175355.026649:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789175355.026672:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175355.027119:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789175355.027132:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789175355.027173:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789175355.027211:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789175355.027271:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789175355.027285:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789175355.027611:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789175355.027621:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789175355.027699:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789175355.027742:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789175355.027861:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789175355.027875:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789175355.028101:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789175355.028111:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789175355.028146:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789175355.028182:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789175355.028559:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789175355.028614:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789175355.028622:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789175355.031736:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789175355.033170:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789175355.033213:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.118@tcp for mdt 20000000:01000000:3.0:1789175355.033216:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789175355.033251:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789175355.033258:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789175355.033288:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789175355.033295:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:3.0:1789175355.033704:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789175355.033717:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789175355.033758:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789175355.033807:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789175355.033887:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789175355.033890:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789175355.033896:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789175355.033903:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789175355.040568:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789175355.040926:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789175355.052630:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789175355.052694:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789175355.052768:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789175355.052788:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789175355.052792:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789175355.052795:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789175355.052807:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789175355.052809:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789175355.052838:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789175355.052840:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789175355.055627:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789175355.056264:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789175355.056313:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789175355.056460:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789175355.056474:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789175355.056477:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789175355.058494:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789175355.063105:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789175355.063182:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789175355.063265:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1789175355.063281:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789175355.063283:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789175355.063290:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789175355.063310:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063327:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063337:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063474:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063481:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063488:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063494:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e793f37f already unused, calling callback (00000000033396dc) 00010000:00010000:3.0:1789175355.063497:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063504:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063517:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063534:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.063540:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e793f37f/0x1112cdeac4c1632d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789175355.063558:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789175355.354935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004257f634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:5818:x1876086274130176:12345-0@lo:253: Request processed in 333175us (333730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.354951:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789175355.355047:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130176:0@lo:253: 10000000:01000000:3.0:1789175355.355065:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789175355.355068:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789175355.355070:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.355072:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.355073:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789175355.355074:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.355076:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.355077:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.355079:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.355080:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789175355.355081:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.355083:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789175355.355103:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003f81e0fc from lustre-MDT0000 10000000:01000000:3.0:1789175355.355131:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789175355.355135:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789175355.355140:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97e7070799c0 10000000:01000000:3.0:1789175355.355144:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175355.355153:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e7070799c0 from 1 10000000:01000000:3.0:1789175355.355156:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789175355.355195:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.355205:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.355226:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.355246:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130304:0@lo:101: 00000100:00100000:3.0:1789175355.355284:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175355.355368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130304 00000100:00100000:0.0:1789175355.355376:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130304 00000100:00100000:0.0:1789175355.355418:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175355.355428:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbb736b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:5818:x1876086274130304:12345-0@lo:101: 00010000:00010000:0.0:1789175355.355440:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789175355.355456:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00010000:00010000:0.0:1789175355.355457:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004405730e/0x1112cdeac4c1633b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16334 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.355483:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004405730e/0x1112cdeac4c1633b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.355494:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004405730e/0x1112cdeac4c1633b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.355503:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004405730e, rc 0) 00000100:00100000:0.0:1789175355.355551:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbb736b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5818:x1876086274130304:12345-0@lo:101: Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.355558:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789175355.355592:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130304:0@lo:101: 00010000:00010000:3.0:1789175355.355603:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.355611:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.355664:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130432:0@lo:501: 00000100:00100000:3.0:1789175355.355690:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.355750:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.355852:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130432 00000100:00100000:2.0:1789175355.355857:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130432 00000100:00100000:2.0:1789175355.355923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175355.355932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d82ddbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5818:x1876086274130432:12345-0@lo:501: 00000100:00100000:2.0:1789175355.356161:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d82ddbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5818:x1876086274130432:12345-0@lo:501: Request processed in 231us (470us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789175355.356168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175355.356237:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130432:0@lo:501: 10000000:01000000:3.0:1789175355.356274:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789175355.356292:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.356300:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000e793f37f/0x1112cdeac4c16334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.356307:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e7201da000 10000000:01000000:3.0:1789175355.356311:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789175355.356320:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97e7201da000 10000000:01000000:3.0:1789175355.356322:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789175355.356325:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97e7201da000 from 1 10000000:01000000:3.0:1789175355.356327:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789175355.356370:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.356377:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.356384:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.356395:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130560:0@lo:101: 00000100:00100000:3.0:1789175355.356421:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.356652:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00000100:00100000:1.0:1789175355.356709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130560 00000100:00100000:1.0:1789175355.356714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130560 00000100:00100000:1.0:1789175355.356740:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789175355.356746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d5eb28f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5818:x1876086274130560:12345-0@lo:101: 00010000:00010000:1.0:1789175355.356754:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175355.356778:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091c47403/0x1112cdeac4c16349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16342 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.356796:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091c47403/0x1112cdeac4c16349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16342 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.356814:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091c47403/0x1112cdeac4c16349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16342 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.356822:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091c47403, rc 0) 00000100:00100000:1.0:1789175355.356919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d5eb28f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:5818:x1876086274130560:12345-0@lo:101: Request processed in 173us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175355.356926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175355.357086:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130560:0@lo:101: 00010000:00010000:3.0:1789175355.357098:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.357106:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.357119:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789175355.357135:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.357141:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000008a21a565/0x1112cdeac4c16342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.357161:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789175355.357164:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175355.357169:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97e7201da000 10000000:01000000:3.0:1789175355.357171:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789175355.357174:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789175355.357176:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789175355.357192:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.357199:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.357206:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.357218:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130688:0@lo:101: 00000100:00100000:3.0:1789175355.357245:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.357312:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00000100:00100000:1.0:1789175355.357411:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130688 00000100:00100000:1.0:1789175355.357417:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130688 00000100:00100000:0.0:1789175355.357499:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789175355.357508:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061a74f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:5818:x1876086274130688:12345-0@lo:101: 00010000:00010000:0.0:1789175355.357517:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175355.357527:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d520b758/0x1112cdeac4c16357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16350 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.357551:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d520b758/0x1112cdeac4c16357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.357559:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d520b758/0x1112cdeac4c16357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.357566:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d520b758, rc 0) 00000100:00100000:0.0:1789175355.357599:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061a74f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+8:5818:x1876086274130688:12345-0@lo:101: Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.357606:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175355.357632:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130688:0@lo:101: 00010000:00010000:3.0:1789175355.357657:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.357664:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.357705:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130816:0@lo:501: 00000100:00100000:3.0:1789175355.357729:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.357852:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.357888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130816 00000100:00100000:2.0:1789175355.357892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130816 00000100:00100000:2.0:1789175355.357923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789175355.357929:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000915eb7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+8:5818:x1876086274130816:12345-0@lo:501: 00000100:00100000:2.0:1789175355.358247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000915eb7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5818:x1876086274130816:12345-0@lo:501: Request processed in 318us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.358255:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175355.358310:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130816:0@lo:501: 00000100:00100000:3.0:1789175355.358337:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130944:0@lo:503: 00000100:00100000:3.0:1789175355.358398:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.358471:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1bee1af going to sleep for 11 seconds 00000100:00100000:0.0:1789175355.358771:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274130944 00000100:00100000:0.0:1789175355.358777:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274130944 00000100:00100000:0.0:1789175355.358861:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789175355.358869:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005589bedd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5818:x1876086274130944:12345-0@lo:503: 00000100:00100000:0.0:1789175355.359037:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005589bedd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5818:x1876086274130944:12345-0@lo:503: Request processed in 169us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.359044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175355.359123:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274130944:0@lo:503: 00000100:00100000:3.0:1789175355.359531:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5861:1876086274131072:0@lo:502: 00000100:00100000:3.0:1789175355.359654:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.366162:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131072 00000100:00100000:1.0:1789175355.366192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131072 00000100:00100000:1.0:1789175355.366266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789175355.366278:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000791fffe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5861:x1876086274131072:12345-0@lo:502: 00000100:00100000:3.0:1789175355.366291:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff3758fb going to sleep for 11 seconds 00000100:00100000:1.0:1789175355.366605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000791fffe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5861:x1876086274131072:12345-0@lo:502: Request processed in 329us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.366664:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5861:1876086274131072:0@lo:502: 00000020:01000000:3.0:1789175355.366707:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175355.366721:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175355.366725:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789175355.366730:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789175355.366733:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789175355.366770:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000039ed1ab1) 00000020:00000080:3.0:1789175355.366792:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789175355.366800:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789175355.367185:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789175355.367193:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c16365 00000100:00100000:1.0:1789175355.367233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:3.0:1789175355.367465:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789175355.367471:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175355.367476:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175355.367477:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789175355.367480:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175355.367484:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175355.367485:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789175355.367488:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789175355.367496:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000036f12f7a) 00000020:00000080:3.0:1789175355.367513:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789175355.367517:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789175355.367520:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789175355.367522:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789175355.367528:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789175355.367575:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003f81e0fc from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789175355.367587:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002e4e1877) 00000020:00000080:3.0:1789175355.367595:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789175355.367664:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789175355.367671:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c1637a 00000020:00000080:3.0:1789175355.367917:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789175355.368494:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789175355.368504:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1112cdeac4c16381 00080000:01000000:3.0:1789175355.368512:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789175355.368516:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c16388 00080000:10000000:3.0:1789175355.369660:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789175355.370274:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789175355.375270:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789175355.467014:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789175355.468114:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789175355.475096:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789175355.476398:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789175355.538461:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b1b10959) 00000020:00000080:3.0:1789175355.538488:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789175355.538572:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789175355.538579:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c16396 00000020:00000080:3.0:1789175355.541522:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789175355.543321:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.580477:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175355.615034:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.651580:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.684184:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175355.719131:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789175355.745832:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1112cdeac4c1639d 00000020:00000080:2.0:1789175355.746311:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789175355.746323:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175355.746329:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175355.746331:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789175355.746335:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175355.746365:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175355.746368:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789175355.746373:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789175355.746415:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789175355.746429:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175355.746433:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175355.746434:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789175355.746436:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175355.746439:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175355.746440:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789175355.746444:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789175355.746450:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789175355.746498:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030b9a93c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5861:1876086274131200:0@lo:502: 00000100:00100000:2.0:1789175355.746574:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175355.746621:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ab498d0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175355.746691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131200 00000100:00100000:0.0:1789175355.746701:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131200 00000100:00100000:0.0:1789175355.746759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175355.746769:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014d02cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5861:x1876086274131200:12345-0@lo:502: 00000100:00100000:0.0:1789175355.747081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014d02cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5861:x1876086274131200:12345-0@lo:502: Request processed in 314us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.747090:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789175355.747298:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030b9a93c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5861:1876086274131200:0@lo:502: 00000020:01000000:2.0:1789175355.747325:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175355.747330:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175355.747332:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789175355.747335:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789175355.747519:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789175355.747536:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789175355.747547:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.747569:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000009e26019d/0x1112cdeac4c16350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.747578:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e7201da000 from 1 10000000:01000000:3.0:1789175355.747581:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789175355.747606:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.747613:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.747621:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.747660:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131328:0@lo:101: 00000100:00100000:3.0:1789175355.747693:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.747724:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5aa7d1d going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.747864:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131328 00000100:00100000:2.0:1789175355.747869:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131328 00000100:00100000:2.0:1789175355.747903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789175355.747910:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1c9345 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:5818:x1876086274131328:12345-0@lo:101: 00010000:00010000:2.0:1789175355.747920:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175355.747935:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c163a4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.747957:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.747967:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.747975:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f1b4c33, rc 0) 00000100:00100000:2.0:1789175355.748015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1c9345 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:5818:x1876086274131328:12345-0@lo:101: Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.748022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789175355.748124:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131328:0@lo:101: 00010000:00010000:3.0:1789175355.748135:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.748145:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.748776:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131456:0@lo:256: 00000100:00100000:3.0:1789175355.748815:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.748842:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5aa7d1d going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.748994:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131456 00000100:00100000:2.0:1789175355.749000:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131456 00000100:00100000:2.0:1789175355.749030:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175355.749036:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b8ecf24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:5818:x1876086274131456:12345-0@lo:256: 20000000:01000000:2.0:1789175355.749053:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789175355.749060:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789175355.749122:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b8ecf24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:5818:x1876086274131456:12345-0@lo:256: Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.749129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789175355.749428:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131456:0@lo:256: 10000000:01000000:3.0:1789175355.750084:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789175355.750108:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.750119:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.750126:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7201da000 from 1 10000000:01000000:3.0:1789175355.750129:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175355.750157:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.750164:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.750172:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.750188:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131584:0@lo:101: 00000100:00100000:3.0:1789175355.750226:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.750383:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5aa7d1d going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.750559:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131584 00000100:00100000:2.0:1789175355.750565:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131584 00000100:00100000:2.0:1789175355.750642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175355.750649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000923b3cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:5818:x1876086274131584:12345-0@lo:101: 00010000:00010000:2.0:1789175355.750659:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175355.750671:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c163b2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.750691:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.750701:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.750709:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0ee114e, rc 0) 00000100:00100000:3.0:1789175355.750896:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131584:0@lo:101: 00010000:00010000:3.0:1789175355.750909:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.750917:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.751052:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131712:0@lo:501: 00000100:00100000:3.0:1789175355.751079:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.751146:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5aa7d1d going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.751180:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000923b3cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131584:12345-0@lo:101: Request processed in 102us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.751187:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175355.751211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131712 00000100:00100000:2.0:1789175355.751215:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131712 00000100:00100000:0.0:1789175355.751252:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789175355.751262:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dec70c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131712:12345-0@lo:501: 00000100:00100000:0.0:1789175355.752010:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dec70c7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131712:12345-0@lo:501: Request processed in 750us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.752018:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175355.752232:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131712:0@lo:501: 00000100:00100000:3.0:1789175355.752272:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131840:0@lo:503: 00000100:00100000:3.0:1789175355.752313:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.752411:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5aa7d1d going to sleep for 11 seconds 00000100:00100000:0.0:1789175355.752477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131840 00000100:00100000:0.0:1789175355.752483:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131840 00000100:00100000:0.0:1789175355.752550:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789175355.752557:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a14aea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131840:12345-0@lo:503: 00000040:00080000:0.0:1789175355.752595:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789175355.752650:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a14aea0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131840:12345-0@lo:503: Request processed in 94us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.752656:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175355.752725:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131840:0@lo:503: 00000040:00080000:3.0:1789175355.753694:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789175355.753864:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789175355.753881:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789175355.753901:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.753912:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175355.753957:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789175355.753960:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e7201da000 10000000:01000000:1.0:1789175355.753963:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e7201da000 10000000:01000000:1.0:1789175355.753967:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789175355.753983:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7201da000 from 1 10000000:01000000:1.0:1789175355.753985:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789175355.754025:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.754033:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.754042:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175355.754060:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131968:0@lo:101: 00000100:00100000:1.0:1789175355.754109:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.754390:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd321df9 going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.754481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274131968 00000100:00100000:2.0:1789175355.754487:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274131968 00000100:00100000:2.0:1789175355.754527:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789175355.754533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065acb521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274131968:12345-0@lo:101: 00010000:00010000:2.0:1789175355.754543:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175355.754554:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008888dc25/0x1112cdeac4c163c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c163c0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.754575:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008888dc25/0x1112cdeac4c163c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.754584:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008888dc25/0x1112cdeac4c163c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175355.754592:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008888dc25, rc 0) 00000100:00100000:2.0:1789175355.754625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065acb521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274131968:12345-0@lo:101: Request processed in 93us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.754643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789175355.754821:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274131968:0@lo:101: 00010000:00010000:1.0:1789175355.754835:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.754843:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175355.754905:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132096:0@lo:501: 00000100:00100000:1.0:1789175355.754931:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.754960:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd321df9 going to sleep for 11 seconds 00000100:00100000:2.0:1789175355.755007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132096 00000100:00100000:2.0:1789175355.755011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132096 00000100:00100000:2.0:1789175355.755073:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789175355.755080:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c779123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274132096:12345-0@lo:501: 00000100:00100000:2.0:1789175355.755317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c779123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274132096:12345-0@lo:501: Request processed in 238us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175355.755325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175355.755416:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132096:0@lo:501: 00000100:00100000:1.0:1789175355.755441:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132224:0@lo:503: 00000100:00100000:1.0:1789175355.755477:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.755641:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd321df9 going to sleep for 11 seconds 00000100:00100000:3.0:1789175355.755688:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132224 00000100:00100000:3.0:1789175355.755692:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132224 00000100:00100000:3.0:1789175355.755714:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789175355.755720:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007825e56d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274132224:12345-0@lo:503: 00000100:00100000:3.0:1789175355.756032:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007825e56d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274132224:12345-0@lo:503: Request processed in 312us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.756039:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789175355.756182:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132224:0@lo:503: 00000100:00100000:1.0:1789175355.756691:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5866:1876086274132352:0@lo:502: 00000100:00100000:1.0:1789175355.756728:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.756824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132352 00000100:00100000:3.0:1789175355.756829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132352 00000100:00100000:3.0:1789175355.756862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789175355.756869:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e986a439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5866:x1876086274132352:12345-0@lo:502: 00000100:00100000:1.0:1789175355.757084:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000960b9594 going to sleep for 11 seconds 00000100:00100000:3.0:1789175355.757296:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e986a439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5866:x1876086274132352:12345-0@lo:502: Request processed in 428us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.757304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789175355.757522:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5866:1876086274132352:0@lo:502: 00000020:01000004:1.0:1789175355.757579:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789175355.757593:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003545e970) 00000020:00000080:1.0:1789175355.757611:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789175355.757695:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003f81e0fc from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789175355.757699:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003f81e0fc from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789175355.757702:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003f81e0fc 4 00010000:00080000:1.0:1789175355.757729:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003ebb6b57@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1789175355.759556:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789175355.763569:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789175355.763613:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789175355.763648:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1112cdeac4c163d5 00000100:00080000:1.0:1789175355.763658:0:5866:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789175355.763663:0:5866:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003ebb6b57 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175355.763702:0:5866:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f1a06e9b x1876086274132480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789175355.763727:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789175355.765213:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274132480:0@lo:38: 00000100:00100000:0.0:1789175355.765310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.765520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132480 00000100:00100000:1.0:1789175355.765529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132480 00000100:00100000:1.0:1789175355.765601:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175355.765609:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000047afff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274132480:12345-0@lo:38: 00000100:00100000:1.0:1789175355.766694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000047afff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274132480:12345-0@lo:38: Request processed in 1079us (1380us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789175355.766721:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175355.767180:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789175355.767190:0:3303:0:(import.c:65:import_set_state_nolock()) 000000003ebb6b57 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175355.767195:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789175355.767198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1a06e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274132480:0@lo:38: 00000100:00100000:1.0:1789175355.767623:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa837bef pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5866:1876086274132608:0@lo:502: 00000100:00100000:1.0:1789175355.767703:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175355.767739:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd2efc11 going to sleep for 11 seconds 00000100:00100000:3.0:1789175355.768253:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132608 00000100:00100000:3.0:1789175355.768268:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132608 00000100:00100000:3.0:1789175355.768308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789175355.768315:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4943284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5866:x1876086274132608:12345-0@lo:502: 00000100:00100000:3.0:1789175355.768554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4943284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5866:x1876086274132608:12345-0@lo:502: Request processed in 240us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.768562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789175355.769244:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa837bef pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5866:1876086274132608:0@lo:502: 00000040:00080000:1.0:1789175355.769277:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789175355.769576:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789175355.769595:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789175355.769653:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.769663:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000fe733e3e/0x1112cdeac4c163c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789175355.769708:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789175355.769711:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.769712:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.769713:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175355.769714:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.769716:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.769717:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.769718:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.769719:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175355.769720:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175355.769722:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.769723:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789175355.769727:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789175355.769730:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789175355.769731:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.769732:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.769733:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175355.769734:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.769735:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.769736:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.769737:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.769743:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175355.769744:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175355.769745:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.769746:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789175355.769826:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789175355.769841:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132736:0@lo:253: 00000100:00100000:3.0:1789175355.769889:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.769930:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064eb1f35 going to sleep for 11 seconds 00000100:00100000:0.0:1789175355.770005:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132736 00000100:00100000:0.0:1789175355.770011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132736 00000100:00100000:0.0:1789175355.770052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789175355.770060:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c538fdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5818:x1876086274132736:12345-0@lo:253: 20000000:01000000:0.0:1789175355.770094:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789175355.770109:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789175355.801591:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789175355.801620:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789175355.801762:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789175355.801768:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789175355.801796:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.801845:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.801854:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.801903:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175355.801919:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 12 pid: 5830 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175355.801935:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000177550a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274132864:0@lo:104: 00000100:00100000:0.0:1789175355.802012:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175355.802068:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b309c3a9 going to sleep for 11 seconds 00000100:00100000:3.0:1789175355.802574:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132864 00000100:00100000:3.0:1789175355.802583:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132864 00000100:00100000:3.0:1789175355.802645:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175355.802654:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039092aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274132864:12345-0@lo:104: 00010000:00010000:3.0:1789175355.802668:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802736:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789175355.802742:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039092aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274132864:12345-0@lo:104: Request processed in 90us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.802759:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789175355.802780:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175355.802786:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802792:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8a790d0 already unused, calling callback (000000009c35b357) 10000000:00010000:3.0:1789175355.802796:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802803:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175355.802821:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175355.802827:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789175355.802858:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802865:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175355.802882:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802889:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.802907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175355.802909:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175355.802910:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175355.802976:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002589d6ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274132992:0@lo:103: 00000100:00100000:3.0:1789175355.803010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175355.803089:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274132992 00000100:00100000:3.0:1789175355.803094:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274132992 00010000:00010000:3.0:1789175355.803112:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 13 pid: 5830 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175355.803135:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175355.803142:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f40e89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3305:x1876086274132992:12345-0@lo:103: 00010000:00010000:3.0:1789175355.803152:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175355.803157:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 13 pid: 5830 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803173:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 13 pid: 5830 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803190:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803197:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789175355.803212:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001445144s 00010000:00010000:3.0:1789175355.803216:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803222:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803228:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803233:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803238:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008785898d already unused, calling callback (00000000033396dc) 00010000:00010000:3.0:1789175355.803241:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803247:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803255:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175355.803276:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175355.803304:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f40e89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3305:x1876086274132992:12345-0@lo:103: Request processed in 164us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175355.803311:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175355.803373:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002589d6ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274132992:0@lo:103: 00010000:00010000:1.0:1789175355.803605:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f1b4c33/0x1112cdeac4c163ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c163a4 expref: 12 pid: 5830 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175355.803618:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000177550a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274132864:0@lo:104: 00010000:00010000:1.0:1789175355.803641:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.803649:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.803654:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175355.803659:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008785898d/0x1112cdeac4c163dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175355.813015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c538fdf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5818:x1876086274132736:12345-0@lo:253: Request processed in 42945us (43115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175355.813033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789175355.813202:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5818:1876086274132736:0@lo:253: 10000000:01000000:3.0:1789175355.813221:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789175355.813225:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789175355.813227:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789175355.813229:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175355.813230:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175355.813231:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175355.813233:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175355.813234:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789175355.813236:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789175355.813237:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175355.813239:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175355.813240:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175355.813241:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789175355.813261:0:5818:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789175355.819580:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.820297:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789175355.820573:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.823706:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789175355.824073:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.824488:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789175355.825856:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.826068:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789175355.826452:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.826844:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789175355.827059:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789175355.827325:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1789175355.875856:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789175355.879041:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789175355.927257:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789175355.927644:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789175355.932092:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789175355.932297:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1789175355.933396:0:5871:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789175355.933402:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:3.0:1789175355.933850:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789175355.936063:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789175355.936539:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175355.940005:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789175355.944170:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789175355.947130:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789175355.954138:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789175355.954420:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789175355.957587:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789175355.957726:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789175355.957845:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789175355.957957:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789175355.958096:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789175355.958241:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789175355.958416:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789175355.958534:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789175355.959003:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789175355.959137:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789175355.959272:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789175355.959498:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789175355.959803:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789175355.959940:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789175355.960056:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789175355.960188:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789175355.960476:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789175355.960974:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789175355.961121:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789175355.961268:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789175355.961454:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789175355.961902:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789175355.962042:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789175355.962187:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789175355.962330:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789175355.962859:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789175355.963033:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789175355.963179:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789175355.963335:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789175355.964018:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789175355.964151:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789175355.964319:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789175355.964849:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789175355.996074:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789175356.061419:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789175356.061464:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb14d8199f988 00100000:10000000:3.0:1789175356.061474:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789175356.063184:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789175356.063202:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789175356.063218:0:5818:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789175356.063237:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789175356.121578:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789175356.121661:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789175356.121666:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789175356.898507:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175357.932655:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175358.949492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175359.969972:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789175360.500286:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789175360.929729:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789175360.929739:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e7201da000 from 3 10000000:01000000:3.0:1789175360.929744:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789175360.929802:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175360.929816:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175360.929826:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175360.929853:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274133120:0@lo:101: 00000100:00100000:3.0:1789175360.929936:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175360.930196:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050be019d going to sleep for 11 seconds 00000100:00080000:0.0:1789175360.930415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789175360.930421:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789175360.930425:0:36:0:(import.c:65:import_set_state_nolock()) 000000003ebb6b57 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789175360.930434:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003ebb6b57 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1789175360.930459:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000064f61058 x1876086274133248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789175360.930645:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064f61058 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274133248:0@lo:38: 00000100:00100000:2.0:1789175360.930693:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175360.930778:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133248 00000100:00100000:3.0:1789175360.930787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133248 00000100:00100000:3.0:1789175360.930825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789175360.930831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030b9a93c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876086274133248:12345-0@lo:38: 00010000:00080000:3.0:1789175360.930855:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1789175360.930895:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1112cdeac4c163ea 00000004:00100000:3.0:1789175360.930945:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789175360.931091:0:5840:0:(import.c:65:import_set_state_nolock()) 00000000423cb6fa : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175360.931291:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133120 00000100:00100000:1.0:1789175360.931297:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133120 00000100:00100000:1.0:1789175360.931359:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789175360.931367:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039dbbb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5835:x1876086274133120:12345-0@lo:101: 00010000:00010000:1.0:1789175360.931377:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175360.931400:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c33f6dd4/0x1112cdeac4c163f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c163e3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175360.931426:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c33f6dd4/0x1112cdeac4c163f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175360.931437:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c33f6dd4/0x1112cdeac4c163f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175360.931447:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c33f6dd4, rc 0) 00000100:00100000:1.0:1789175360.931497:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039dbbb84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274133120:12345-0@lo:101: Request processed in 131us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175360.931503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789175360.931723:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000495ff57a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274133120:0@lo:101: 00010000:00010000:1.0:1789175360.931742:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175360.931750:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175360.931813:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa837bef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274133376:0@lo:256: 00000100:00100000:1.0:1789175360.931852:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175360.931878:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f824e89a going to sleep for 11 seconds 00000100:00100000:0.0:1789175360.932417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133376 00000100:00100000:0.0:1789175360.932423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133376 00000100:00100000:0.0:1789175360.932461:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175360.932478:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345dcec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274133376:12345-0@lo:256: 20000000:01000000:0.0:1789175360.932494:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789175360.932518:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789175360.932522:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789175360.932630:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345dcec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274133376:12345-0@lo:256: Request processed in 153us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175360.932637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175360.932678:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa837bef pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274133376:0@lo:256: 10000000:01000000:0.0:1789175360.932723:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789175360.932730:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175360.932740:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000e8a790d0/0x1112cdeac4c163e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175360.933048:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030b9a93c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876086274133248:12345-0@lo:38: Request processed in 2214us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175360.933060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789175360.934225:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000064f61058 x1876086274133248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789175360.934250:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789175360.934260:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789175360.934265:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789175360.934269:0:3303:0:(import.c:65:import_set_state_nolock()) 000000003ebb6b57 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789175360.934276:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064f61058 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274133248:0@lo:38: 00010000:00010000:3.0:1789175360.993614:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175362.020404:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175363.043302:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175364.065514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175365.090052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789175365.591177:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4fca5810 20000000:00000080:1.0:1789175365.591198:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e70770f000 uarg=0000000000000000 20000000:01000000:1.0:1789175365.591233:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789175365.591242:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789175365.591248:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789175365.592255:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789175365.592280:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789175365.595944:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789175365.596257:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789175365.596316:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789175365.596463:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789175365.596485:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789175365.596503:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175365.596522:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175365.596530:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175365.596573:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175365.596712:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 11 pid: 5833 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175365.596727:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004450b245 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876086274133504:0@lo:104: 00000100:00100000:1.0:1789175365.596789:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175365.596886:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fe98eae going to sleep for 11 seconds 00000100:00100000:2.0:1789175365.597266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133504 00000100:00100000:2.0:1789175365.597279:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133504 00000100:00100000:2.0:1789175365.597542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175365.597554:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f7836b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:6316:x1876086274133504:12345-0@lo:104: 00010000:00010000:2.0:1789175365.597572:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175365.597858:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004450b245 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876086274133504:0@lo:104: 00010000:00010000:3.0:1789175365.597880:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175365.597913:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175365.597919:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f7836b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:6316:x1876086274133504:12345-0@lo:104: Request processed in 368us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175365.597927:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789175365.597967:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175365.597973:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.597979:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005850b430 already unused, calling callback (000000009c35b357) 10000000:00010000:0.0:1789175365.597982:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.597991:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175365.597997:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175365.598002:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789175365.598048:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598055:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175365.598076:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598082:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598101:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175365.598103:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175365.598104:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175365.598191:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000654f343c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274133632:0@lo:103: 00000100:00100000:0.0:1789175365.598231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175365.598282:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133632 00000100:00100000:0.0:1789175365.598288:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133632 00010000:00010000:0.0:1789175365.598306:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 12 pid: 5833 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175365.598330:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175365.598337:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b7236d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3306:x1876086274133632:12345-0@lo:103: 00010000:00010000:0.0:1789175365.598514:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175365.598518:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 12 pid: 5833 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598529:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 12 pid: 5833 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598542:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e0ee114e/0x1112cdeac4c163b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c163b2 expref: 12 pid: 5833 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598556:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598565:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598936:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598946:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598962:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598968:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598974:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009893820 already unused, calling callback (00000000033396dc) 00010000:00010000:0.0:1789175365.598978:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598985:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.598999:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175365.599010:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175365.599054:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b7236d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:3306:x1876086274133632:12345-0@lo:103: Request processed in 718us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175365.599060:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175365.599102:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000654f343c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274133632:0@lo:103: 00010000:00010000:3.0:1789175365.599558:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175365.599567:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175365.599572:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009893820/0x1112cdeac4c163f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175366.052146:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df67eb2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274133888:0@lo:400: 00000100:00100000:0.0:1789175366.052146:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002589d6ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274133760:0@lo:400: 00000100:00100000:3.0:1789175366.052363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175366.052842:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133888 00000100:00100000:2.0:1789175366.052856:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133888 00000100:00100000:2.0:1789175366.052958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175366.052968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a7109e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274133888:12345-0@lo:400: 00000100:00100000:2.0:1789175366.053075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a7109e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274133888:12345-0@lo:400: Request processed in 109us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175366.053083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789175366.053155:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000df67eb2a x1876086274133888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175366.053170:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df67eb2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274133888:0@lo:400: 00000100:00100000:0.0:1789175366.058231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175366.058557:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274133760 00000100:00100000:3.0:1789175366.058568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274133760 00000100:00100000:3.0:1789175366.058619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789175366.058628:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c376495f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:3307:x1876086274133760:12345-0@lo:400: 00000100:00100000:3.0:1789175366.058700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c376495f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:3307:x1876086274133760:12345-0@lo:400: Request processed in 73us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175366.058707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789175366.059200:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002589d6ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274133760:0@lo:400: 00010000:00010000:3.0:1789175366.125580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789175366.498803:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789175366.498813:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7201da000 from 1 10000000:01000000:3.0:1789175366.498817:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175366.498873:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175366.498885:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175366.498894:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175366.498916:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055ca7398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134016:0@lo:101: 00000100:00100000:3.0:1789175366.498985:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175366.499057:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd1dd51f going to sleep for 11 seconds 00000100:00100000:1.0:1789175366.499208:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134016 00000100:00100000:1.0:1789175366.499217:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134016 00000100:00100000:1.0:1789175366.499288:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789175366.499296:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d1bbeae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:5835:x1876086274134016:12345-0@lo:101: 00010000:00010000:1.0:1789175366.499311:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175366.499325:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000134c37ae/0x1112cdeac4c16406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c163ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175366.499395:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000134c37ae/0x1112cdeac4c16406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175366.499406:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000134c37ae/0x1112cdeac4c16406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175366.499416:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000134c37ae, rc 0) 00000100:00100000:1.0:1789175366.499484:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d1bbeae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274134016:12345-0@lo:101: Request processed in 189us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175366.499492:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789175366.499575:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055ca7398 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134016:0@lo:101: 00010000:00010000:2.0:1789175366.499591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175366.499601:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000005850b430/0x1112cdeac4c163ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175366.499659:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd56149d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134144:0@lo:501: 00000100:00100000:2.0:1789175366.499687:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175366.499720:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078ab25d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789175366.500975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134144 00000100:00100000:1.0:1789175366.500988:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134144 00000100:00100000:1.0:1789175366.501043:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789175366.501051:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086b0ef14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274134144:12345-0@lo:501: 00000100:00100000:1.0:1789175366.501374:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086b0ef14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274134144:12345-0@lo:501: Request processed in 323us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175366.501382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789175366.501869:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd56149d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134144:0@lo:501: 00000100:00100000:1.0:1789175366.501919:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2f703b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134272:0@lo:503: 00000100:00100000:1.0:1789175366.501967:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175366.502051:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000002dbaa733 going to sleep for 11 seconds 00000100:00100000:2.0:1789175366.507866:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134272 00000100:00100000:2.0:1789175366.507884:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134272 00000100:00100000:2.0:1789175366.507943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175366.507953:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7e6b8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274134272:12345-0@lo:503: 00000100:00100000:2.0:1789175366.508186:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7e6b8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274134272:12345-0@lo:503: Request processed in 234us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175366.508194:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175366.508273:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2f703b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274134272:0@lo:503: 00000100:00100000:2.0:1789175366.519027:0:6335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071f715ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6335:1876086274134400:0@lo:502: 00000100:00100000:2.0:1789175366.519123:0:6335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175366.519175:0:6335:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfb933d8 going to sleep for 11 seconds 00000100:00100000:0.0:1789175366.519247:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134400 00000100:00100000:0.0:1789175366.519254:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134400 00000100:00100000:0.0:1789175366.519299:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789175366.519306:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3baf7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6335:x1876086274134400:12345-0@lo:502: 00000100:00100000:0.0:1789175366.519572:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3baf7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6335:x1876086274134400:12345-0@lo:502: Request processed in 265us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175366.519584:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789175366.519911:0:6335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071f715ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6335:1876086274134400:0@lo:502: 00000020:01000000:2.0:1789175366.519941:0:6335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175366.519950:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175366.519953:0:6335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789175366.519959:0:6335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7201da000 00000020:00000080:2.0:1789175366.519961:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789175366.520002:0:6335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6335:1876086274134528:0@lo:502: 00000100:00100000:2.0:1789175366.520032:0:6335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175366.520061:0:6335:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175366.520111:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134528 00000100:00100000:3.0:1789175366.520116:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134528 00000100:00100000:3.0:1789175366.520149:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789175366.520156:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6335:x1876086274134528:12345-0@lo:502: 00000100:00100000:3.0:1789175366.520275:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6335:x1876086274134528:12345-0@lo:502: Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175366.520281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789175366.520378:0:6335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6335:1876086274134528:0@lo:502: 00000020:01000000:2.0:1789175366.520405:0:6335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175366.520409:0:6335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175366.520410:0:6335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789175366.520413:0:6335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789175366.520649:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789175366.520669:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175366.520679:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175366.520691:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175367.137581:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175368.169801:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175369.191614:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175370.214879:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175371.169916:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789175371.169980:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274134656:0@lo:400: 00000100:00100000:1.0:1789175371.170108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175371.170188:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274134784:0@lo:400: 00000100:00100000:1.0:1789175371.170276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175371.170373:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134784 00000100:00100000:1.0:1789175371.170383:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134784 00000100:00100000:1.0:1789175371.170448:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175371.170459:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274134784:12345-0@lo:400: 00000100:00100000:2.0:1789175371.170625:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134656 00000100:00100000:2.0:1789175371.170630:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134656 00000100:00100000:2.0:1789175371.170668:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789175371.170676:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3304:x1876086274134656:12345-0@lo:400: 00000100:00100000:2.0:1789175371.170747:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3304:x1876086274134656:12345-0@lo:400: Request processed in 71us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175371.170754:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789175371.170872:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274134656:0@lo:400: 00000100:00100000:1.0:1789175371.171863:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274134784:12345-0@lo:400: Request processed in 1400us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175371.171875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789175371.176929:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e733f50a80 x1876086274134784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175371.176957:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274134784:0@lo:400: 00010000:00010000:1.0:1789175371.239626:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175372.260014:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789175372.885227:0:6683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789175372.885232:0:6683:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789175372.885618:0:6683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e73c3b2800 00000020:01000004:2.0:1789175372.885636:0:6683:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789175372.885648:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789175372.885662:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97e7076db380) 00000020:00000080:2.0:1789175372.885692:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789175372.909722:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789175372.910051:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789175372.932244:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789175372.943535:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789175372.943584:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789175372.943650:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789175372.943677:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789175372.944223:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789175372.944238:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789175372.944255:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1112cdeac4c16414 00000020:01000004:3.0:1789175372.944267:0:6683:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789175372.944298:0:6683:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789175372.944303:0:6683:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789175372.944310:0:6683:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789175372.944315:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789175372.944525:0:6683:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97e726b83380) 00000020:00000080:3.0:1789175372.944548:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789175372.946851:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175372.948686:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789175372.949666:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789175372.952042:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789175372.952059:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789175372.952904:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789175372.952913:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789175372.955897:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789175372.960608:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789175372.960628:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789175372.963528:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789175372.963561:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789175373.008081:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789175373.009869:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789175373.009879:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789175373.020006:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789175373.020323:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789175373.021798:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789175373.021811:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789175373.024642:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175373.024900:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789175373.024907:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789175373.045280:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789175373.045306:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789175373.134603:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175373.135470:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789175373.135480:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789175373.136987:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789175373.136999:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789175373.140042:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789175373.140080:0:6683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789175373.140088:0:6683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789175373.193070:0:6683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789175373.193142:0:6683:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789175373.193149:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789175373.193151:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789175373.193152:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175373.193154:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175373.193155:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175373.193156:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175373.193158:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175373.193160:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789175373.193162:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789175373.193163:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175373.193169:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789175373.193175:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789175373.193177:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789175373.193179:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789175373.193180:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175373.193181:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175373.193182:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175373.193183:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175373.193184:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175373.193184:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789175373.193185:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789175373.193186:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175373.193187:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789175373.193222:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789175373.193248:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274134912:0@lo:253: 00000100:00100000:1.0:1789175373.193428:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.193756:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.193807:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274134912 00000100:00100000:0.0:1789175373.193817:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274134912 00000100:00100000:0.0:1789175373.193970:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789175373.193983:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274134912:12345-0@lo:253: 20000000:01000000:0.0:1789175373.194031:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789175373.194037:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789175373.194044:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789175373.194049:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789175373.196006:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789175373.196235:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789175373.196254:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789175373.196295:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789175373.196304:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789175373.197781:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789175373.197911:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789175373.198381:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789175373.198411:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:0.0:1789175373.198414:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:0.0:1789175373.198451:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789175373.198461:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789175373.198511:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789175373.198521:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1789175373.198556:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789175373.198566:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789175373.198597:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789175373.198803:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789175373.202172:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789175373.202237:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:0.0:1789175373.202240:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:0.0:1789175373.202280:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789175373.202289:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789175373.202320:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789175373.202363:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1789175373.202414:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789175373.202427:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789175373.202458:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789175373.202519:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789175373.202539:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789175373.202543:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789175373.202547:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789175373.202564:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789175373.202567:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789175373.202605:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789175373.202608:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789175373.204953:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789175373.205061:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789175373.205115:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789175373.208221:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789175373.208286:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789175373.208320:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789175373.208432:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789175373.208437:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789175373.209595:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789175373.210180:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789175373.210239:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789175373.210313:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789175373.210378:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789175373.210381:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789175373.211172:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789175373.211224:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789175373.211263:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789175373.211979:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789175373.212015:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789175373.212068:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789175373.212089:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789175373.212091:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789175373.212103:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789175373.212131:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212154:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212162:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212169:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212193:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212242:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.212259:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 12 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175373.212277:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135040:0@lo:104: 00000100:00100000:1.0:1789175373.213176:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.213365:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135040 00000100:00100000:2.0:1789175373.213376:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135040 00000100:00100000:2.0:1789175373.213439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789175373.213451:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5830:x1876086274135040:12345-0@lo:104: 00010000:00010000:2.0:1789175373.213588:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.213769:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175373.213778:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5830:x1876086274135040:12345-0@lo:104: Request processed in 328us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.213786:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789175373.213940:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.213951:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 12 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.213986:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135168:0@lo:104: 00000100:00100000:0.0:1789175373.214026:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789175373.214057:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.214066:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 12 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.214074:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135296:0@lo:104: 00000100:00100000:0.0:1789175373.214094:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175373.214116:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.214148:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135040:0@lo:104: 00000100:00100000:3.0:1789175373.214215:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135168 00000100:00100000:3.0:1789175373.214220:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135168 00000100:00100000:3.0:1789175373.214244:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135296 00000100:00100000:3.0:1789175373.214252:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135296 00000100:00100000:3.0:1789175373.214266:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175373.214272:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5830:x1876086274135168:12345-0@lo:104: 00010000:00010000:3.0:1789175373.214284:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.214476:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135168:0@lo:104: 00010000:00010000:1.0:1789175373.214912:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789175373.214924:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.214934:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205fe00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175373.214938:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.214949:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175373.214958:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175373.214965:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789175373.215062:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789175373.215072:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5830:x1876086274135168:12345-0@lo:104: Request processed in 799us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.215081:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175373.215120:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175373.215128:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5830:x1876086274135296:12345-0@lo:104: 00010000:00010000:3.0:1789175373.215139:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.215197:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789175373.215203:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5830:x1876086274135296:12345-0@lo:104: Request processed in 76us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.215208:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789175373.215261:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789175373.215365:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1876086274135296:0@lo:104: 00010000:00010000:1.0:1789175373.215400:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.216063:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175373.216102:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.216111:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701527000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175373.216115:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.216123:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175373.216129:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175373.216134:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789175373.216185:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.216192:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789175373.216214:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.216220:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701527000/0x1112cdeac4c16350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16357 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.216237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.216239:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.216241:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175373.216258:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274135424:0@lo:103: 00000100:00100000:1.0:1789175373.216317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175373.216479:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135424 00000100:00100000:0.0:1789175373.216487:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135424 00010000:00010000:0.0:1789175373.216518:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.216562:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175373.216570:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3307:x1876086274135424:12345-0@lo:103: 00010000:00010000:0.0:1789175373.216584:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175373.216590:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.216601:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.216626:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16350 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.216727:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175373.216776:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3307:x1876086274135424:12345-0@lo:103: Request processed in 207us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.216784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175373.216827:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274135424:0@lo:103: 00010000:00010000:1.0:1789175373.220827:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.220834:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.220837:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175373.220919:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.220935:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701527600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175373.220939:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.220950:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175373.220958:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175373.220964:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175373.221037:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.221044:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175373.221066:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.221094:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1633b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.221113:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175373.221115:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175373.221116:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175373.221255:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.221263:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175373.221270:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.221291:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205fe00/0x1112cdeac4c163c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163c7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.221311:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175373.221313:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175373.221314:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175373.221468:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274135552:0@lo:103: 00000100:00100000:3.0:1789175373.221574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.221652:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175373.221659:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274135680:0@lo:103: 00000100:00100000:3.0:1789175373.221682:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.224509:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135552 00000100:00100000:1.0:1789175373.224539:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135552 00010000:00010000:0.0:1789175373.224720:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 12 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.224784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135680 00000100:00100000:0.0:1789175373.224788:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135680 00010000:00010000:0.0:1789175373.224802:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 13 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.224818:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175373.224828:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3304:x1876086274135552:12345-0@lo:103: 00010000:00010000:0.0:1789175373.224847:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175373.224853:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.224867:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.224889:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031400/0x1112cdeac4c1633b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16334 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.224915:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175373.225010:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3304:x1876086274135552:12345-0@lo:103: Request processed in 183us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.225041:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175373.225062:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789175373.225070:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:3304:x1876086274135680:12345-0@lo:103: 00010000:00010000:0.0:1789175373.225078:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175373.225082:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 11 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225090:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 11 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225100:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c163c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c163c0 expref: 11 pid: 5833 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225113:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225123:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225143:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225151:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225158:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225164:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225179:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205e200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175373.225185:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225195:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225219:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225231:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175373.225258:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:3304:x1876086274135680:12345-0@lo:103: Request processed in 190us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.225264:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789175373.225291:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225300:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.225306:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16422 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789175373.225335:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789175373.225716:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274135680:0@lo:103: 00000100:00100000:3.0:1789175373.225730:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274135552:0@lo:103: 00010000:00010000:1.0:1789175373.281451:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175373.359383:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:6683:x1876086274134912:12345-0@lo:253: Request processed in 165384us (165938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.359405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789175373.362145:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274134912:0@lo:253: 10000000:01000000:1.0:1789175373.362168:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789175373.362171:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789175373.362173:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789175373.362175:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175373.362176:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789175373.362177:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175373.362178:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175373.362180:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175373.362182:0:6683:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789175373.362184:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175373.362185:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789175373.362224:0:6683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e73c3b2800 from lustre-OST0000 10000000:01000000:1.0:1789175373.362258:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789175373.362261:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789175373.362275:0:6683:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e7070799c0 local copy 10000000:01000000:1.0:1789175373.362279:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789175373.362337:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.363921:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.363935:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175373.363967:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274135808:0@lo:101: 00000100:00100000:1.0:1789175373.364070:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.364875:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1789175373.371782:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135808 00000100:00100000:2.0:1789175373.371810:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135808 00000100:00100000:3.0:1789175373.372021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789175373.372038:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:6683:x1876086274135808:12345-0@lo:101: 00010000:00010000:3.0:1789175373.372061:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175373.372088:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e701526a00/0x1112cdeac4c16430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16429 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.372121:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e701526a00/0x1112cdeac4c16430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16429 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.372134:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e701526a00/0x1112cdeac4c16430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16429 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.372164:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e701526a00, rc 0) 00000100:00100000:3.0:1789175373.372809:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:6683:x1876086274135808:12345-0@lo:101: Request processed in 771us (8735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.372817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789175373.377663:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274135808:0@lo:101: 00010000:00010000:1.0:1789175373.377712:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.377726:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175373.382420:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274135936:0@lo:501: 00000100:00100000:0.0:1789175373.382525:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175373.382615:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175373.382752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274135936 00000100:00100000:2.0:1789175373.382762:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274135936 00000100:00100000:2.0:1789175373.382837:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789175373.382850:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:6683:x1876086274135936:12345-0@lo:501: 00000100:00100000:2.0:1789175373.383454:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:6683:x1876086274135936:12345-0@lo:501: Request processed in 604us (926us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789175373.383463:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789175373.383560:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274135936:0@lo:501: 10000000:01000000:3.0:1789175373.383597:0:6683:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789175373.383664:0:6683:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789175373.383675:0:6683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.383689:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.383698:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.383721:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789175373.383759:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e73c3b2800 10000000:01000000:3.0:1789175373.383766:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789175373.383772:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97e7070799c0 10000000:01000000:3.0:1789175373.383775:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789175373.383779:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97e7070799c0 from 1 10000000:01000000:3.0:1789175373.383782:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789175373.383824:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.383834:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.383862:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175373.383886:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136064:0@lo:101: 00000100:00100000:3.0:1789175373.383951:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.384008:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e718282840 going to sleep for 11 seconds 00010000:00010000:1.0:1789175373.387646:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175373.387670:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.387685:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205ee00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175373.387690:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.387703:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175373.387711:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175373.387718:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789175373.387776:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.387783:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789175373.387839:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.387872:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16430 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.387903:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.387905:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175373.387906:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175373.388033:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274136192:0@lo:103: 00000100:00100000:3.0:1789175373.388141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175373.388394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136064 00000100:00100000:0.0:1789175373.388409:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136064 00000100:00100000:0.0:1789175373.388487:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789175373.388501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:6683:x1876086274136064:12345-0@lo:101: 00010000:00010000:0.0:1789175373.388521:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175373.388546:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031400/0x1112cdeac4c1643e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16437 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.388577:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031400/0x1112cdeac4c1643e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16437 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.388590:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031400/0x1112cdeac4c1643e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16437 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.388601:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031400, rc 0) 00000100:00100000:0.0:1789175373.388678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136064:12345-0@lo:101: Request processed in 182us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.388685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789175373.389812:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136064:0@lo:101: 00010000:00010000:3.0:1789175373.389845:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.389859:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175373.389886:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789175373.389988:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.389998:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175373.390007:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789175373.390018:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175373.390027:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789175373.390030:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789175373.390073:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.390097:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.390107:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175373.390127:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136320:0@lo:101: 00000100:00100000:3.0:1789175373.390192:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.390234:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e718282840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175373.391796:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136192 00000100:00100000:1.0:1789175373.391813:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136192 00000100:00100000:1.0:1789175373.391895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175373.391905:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:3306:x1876086274136192:12345-0@lo:103: 00010000:00010000:1.0:1789175373.391932:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175373.391952:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e701526a00/0x1112cdeac4c16430 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16429 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.391976:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175373.392056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:3306:x1876086274136192:12345-0@lo:103: Request processed in 152us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.392064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175373.392466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136320 00000100:00100000:1.0:1789175373.392472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136320 00000100:00100000:1.0:1789175373.392497:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789175373.392604:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+10:6683:x1876086274136320:12345-0@lo:101: 00010000:00010000:1.0:1789175373.392620:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175373.392637:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16445 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.392660:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.392687:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175373.392695:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205f200, rc 0) 00000100:00100000:1.0:1789175373.392734:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136320:12345-0@lo:101: Request processed in 230us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.392740:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789175373.393018:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274136192:0@lo:103: 00000100:00100000:3.0:1789175373.393090:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136320:0@lo:101: 00010000:00010000:3.0:1789175373.393108:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.393118:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175373.393285:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136448:0@lo:501: 00000100:00100000:3.0:1789175373.393374:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.393416:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e718282840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175373.393829:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136448 00000100:00100000:1.0:1789175373.393840:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136448 00000100:00100000:1.0:1789175373.393877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789175373.393885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136448:12345-0@lo:501: 00000100:00100000:1.0:1789175373.395100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136448:12345-0@lo:501: Request processed in 1207us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.395114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789175373.395935:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136448:0@lo:501: 00000100:00100000:3.0:1789175373.395999:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136576:0@lo:503: 00000100:00100000:3.0:1789175373.396079:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.396161:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e718282840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.396983:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136576 00000100:00100000:0.0:1789175373.396996:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136576 00000100:00100000:0.0:1789175373.397055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789175373.397067:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136576:12345-0@lo:503: 00000100:00100000:0.0:1789175373.397334:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136576:12345-0@lo:503: Request processed in 269us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.397359:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789175373.397715:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136576:0@lo:503: 00000040:00080000:1.0:1789175373.398061:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789175373.398147:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136704:0@lo:502: 00000100:00100000:1.0:1789175373.398210:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.398249:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.398435:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136704 00000100:00100000:0.0:1789175373.398451:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136704 00000100:00100000:0.0:1789175373.398497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789175373.398516:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136704:12345-0@lo:502: 00000100:00100000:0.0:1789175373.398700:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136704:12345-0@lo:502: Request processed in 194us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.398714:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789175373.399131:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136704:0@lo:502: 00000040:00080000:1.0:1789175373.399675:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789175373.399737:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789175373.399848:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789175373.399898:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789175373.399938:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789175373.399972:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789175373.400022:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136832:0@lo:502: 00000100:00100000:1.0:1789175373.400088:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.400122:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.400282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136832 00000100:00100000:0.0:1789175373.400289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136832 00000100:00100000:0.0:1789175373.400371:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789175373.400382:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136832:12345-0@lo:502: 00000100:00100000:0.0:1789175373.401061:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136832:12345-0@lo:502: Request processed in 676us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.401071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789175373.401187:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136832:0@lo:502: 00000040:00080000:2.0:1789175373.401966:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789175373.401982:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789175373.403027:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789175373.403037:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789175373.403044:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175373.403047:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789175373.403053:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789175373.403072:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97e70707cd40) 00000020:00000080:1.0:1789175373.403097:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789175373.403104:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789175373.403277:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e73c3b2800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789175373.403286:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789175373.403293:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1112cdeac4c1645a 00010000:00010000:0.0:1789175373.409822:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789175373.410304:0:6704:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789175373.413969:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789175373.415227:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789175373.432415:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789175373.435683:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789175373.440598:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789175373.440619:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175373.440628:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175373.440631:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789175373.440634:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175373.440639:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175373.440641:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789175373.440643:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789175373.440645:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789175373.440721:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175373.440724:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175373.440726:0:6704:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789175373.440729:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789175373.442745:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789175373.442801:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789175373.443294:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.443311:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175373.443385:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73c3b2800 from 1 10000000:01000000:2.0:1789175373.443389:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175373.443441:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.443449:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.443471:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.443501:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136960:0@lo:101: 00000100:00100000:2.0:1789175373.443607:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.443671:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047240 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.445355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274136960 00000100:00100000:0.0:1789175373.445374:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274136960 00000100:00100000:0.0:1789175373.445454:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789175373.445465:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:6683:x1876086274136960:12345-0@lo:101: 00010000:00010000:0.0:1789175373.445485:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175373.445506:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16461 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.445541:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.445555:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.445565:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031e00, rc 0) 00000100:00100000:0.0:1789175373.446478:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274136960:12345-0@lo:101: Request processed in 1008us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.446504:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789175373.448942:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274136960:0@lo:101: 00010000:00010000:2.0:1789175373.448980:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.448997:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.449168:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137088:0@lo:501: 00000100:00100000:2.0:1789175373.449358:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.449410:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047240 going to sleep for 11 seconds 00000100:00100000:1.0:1789175373.449545:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137088 00000100:00100000:1.0:1789175373.449560:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137088 00000100:00100000:0.0:1789175373.457880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789175373.457904:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137088:12345-0@lo:501: 00000100:00100000:0.0:1789175373.458413:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137088:12345-0@lo:501: Request processed in 517us (9072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.458562:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137088:0@lo:501: 00000100:00100000:1.0:1789175373.458638:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137216:0@lo:503: 00000100:00100000:1.0:1789175373.458708:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.458768:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.458816:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789175373.458858:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137216 00000100:00100000:0.0:1789175373.458865:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137216 00000100:00100000:0.0:1789175373.458903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789175373.458913:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137216:12345-0@lo:503: 00000100:00100000:0.0:1789175373.459287:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137216:12345-0@lo:503: Request processed in 376us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.459295:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789175373.459635:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137216:0@lo:503: 00000040:00080000:1.0:1789175373.459981:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789175373.460058:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137344:0@lo:502: 00000100:00100000:1.0:1789175373.460108:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.460136:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175373.460408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137344 00000100:00100000:2.0:1789175373.460426:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137344 00000100:00100000:2.0:1789175373.461211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789175373.461226:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137344:12345-0@lo:502: 00000100:00100000:3.0:1789175373.462982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137344:12345-0@lo:502: Request processed in 1747us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.463000:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789175373.463788:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137344:0@lo:502: 00000040:00080000:1.0:1789175373.464172:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789175373.464276:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789175373.464377:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137472:0@lo:502: 00000100:00100000:2.0:1789175373.469248:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.469432:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789175373.477189:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137472 00000100:00100000:3.0:1789175373.477210:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137472 00000100:00100000:3.0:1789175373.477272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789175373.477284:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137472:12345-0@lo:502: 00000100:00100000:3.0:1789175373.478650:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137472:12345-0@lo:502: Request processed in 1363us (9404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.478665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789175373.483801:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137472:0@lo:502: 00000040:00080000:0.0:1789175373.484174:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789175373.484198:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789175373.484996:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175373.485008:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175373.485011:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789175373.485017:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e73c3b2800 00000020:00000080:0.0:1789175373.485018:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789175373.485031:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175373.485033:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175373.485034:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789175373.485036:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789175373.485903:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789175373.485956:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175373.485981:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.485997:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175373.486068:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789175373.486072:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e73c3b2800 10000000:01000000:2.0:1789175373.486074:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e73c3b2800 10000000:01000000:2.0:1789175373.486078:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789175373.486086:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e73c3b2800 from 1 10000000:01000000:2.0:1789175373.486089:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789175373.486130:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.486139:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.486150:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.486176:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137600:0@lo:101: 00000100:00100000:2.0:1789175373.486261:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.486312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137600 00000100:00100000:3.0:1789175373.486338:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137600 00000100:00100000:3.0:1789175373.486457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789175373.486482:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274137600:12345-0@lo:101: 00010000:00010000:3.0:1789175373.486504:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175373.486525:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1646f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.486583:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.486596:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.486608:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e701527000, rc 0) 00000100:00100000:2.0:1789175373.487420:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175373.487606:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137600:12345-0@lo:101: Request processed in 1125us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.488082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789175373.488848:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137600:0@lo:101: 00010000:00010000:2.0:1789175373.488910:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.488923:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.489078:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137728:0@lo:501: 00000100:00100000:2.0:1789175373.489152:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.489224:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175373.489235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137728 00000100:00100000:3.0:1789175373.489248:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137728 00000100:00100000:3.0:1789175373.489307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789175373.489317:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137728:12345-0@lo:501: 00000100:00100000:3.0:1789175373.489890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137728:12345-0@lo:501: Request processed in 573us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.489896:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789175373.491008:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137728:0@lo:501: 00000100:00100000:2.0:1789175373.491096:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137856:0@lo:503: 00000100:00100000:2.0:1789175373.491188:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.491250:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175373.491284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137856 00000100:00100000:3.0:1789175373.491293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137856 00000100:00100000:3.0:1789175373.491451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789175373.491563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137856:12345-0@lo:503: 00000100:00100000:3.0:1789175373.492029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137856:12345-0@lo:503: Request processed in 567us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175373.492038:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789175373.492211:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137856:0@lo:503: 00000040:00080000:2.0:1789175373.492968:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789175373.493096:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137984:0@lo:502: 00000100:00100000:2.0:1789175373.493166:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.493296:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175373.493540:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274137984 00000100:00100000:0.0:1789175373.493549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274137984 00000100:00100000:0.0:1789175373.493710:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789175373.493734:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137984:12345-0@lo:502: 00000100:00100000:0.0:1789175373.494187:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274137984:12345-0@lo:502: Request processed in 463us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175373.494197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789175373.494317:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274137984:0@lo:502: 00000040:00080000:3.0:1789175373.494983:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789175373.495059:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789175373.495096:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789175373.495159:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789175373.495200:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789175373.495264:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789175373.495304:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789175373.495381:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789175373.495449:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789175373.495500:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789175373.495536:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789175373.495598:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789175373.495720:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789175373.496055:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789175373.496109:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789175373.496149:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789175373.496186:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789175373.496237:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789175373.496274:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789175373.496360:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789175373.496415:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789175373.496453:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789175373.496489:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789175373.496541:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789175373.496579:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789175373.497546:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789175373.503078:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789175373.503214:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789175373.503290:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274138112:0@lo:502: 00000100:00100000:3.0:1789175373.503485:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.503805:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138112 00000100:00100000:2.0:1789175373.503828:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138112 00000100:00100000:2.0:1789175373.503910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789175373.503924:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274138112:12345-0@lo:502: 00000100:00100000:2.0:1789175373.504225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274138112:12345-0@lo:502: Request processed in 302us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.504235:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789175373.505253:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc98540 going to sleep for 11 seconds 00000100:00100000:3.0:1789175373.505296:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274138112:0@lo:502: 00000040:00080000:3.0:1789175373.505490:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789175373.505521:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789175373.506897:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789175373.506921:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97e726670000) 00000020:00000080:0.0:1789175373.506949:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789175373.507068:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e73c3b2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789175373.507073:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e73c3b2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789175373.507077:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e73c3b2800 3 00010000:00080000:0.0:1789175373.507130:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e73fcaf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1789175373.513508:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789175373.513950:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789175373.514008:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789175373.514030:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1112cdeac4c16484 00000100:00080000:0.0:1789175373.514048:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789175373.514058:0:6709:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97e73fcaf800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1789175373.514112:0:6709:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e726706a00 x1876086274138240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789175373.514212:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274138240:0@lo:38: 00000100:00100000:3.0:1789175373.514336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789175373.514680:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789175373.515009:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138240 00000100:00100000:1.0:1789175373.515022:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138240 00000100:00100000:1.0:1789175373.515069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175373.515081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274138240:12345-0@lo:38: 00010000:00080000:1.0:1789175373.515115:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1789175373.515162:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1112cdeac4c1648b 00000004:00100000:1.0:1789175373.515185:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789175373.515229:0:5838:0:(import.c:65:import_set_state_nolock()) ffff97e737dde800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175373.519760:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274138368:0@lo:400: 00000100:00100000:0.0:1789175373.519862:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175373.519982:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876086274138240:12345-0@lo:38: Request processed in 4899us (5643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.519994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175373.520035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138368 00000100:00100000:1.0:1789175373.520044:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138368 00000100:00100000:1.0:1789175373.520095:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175373.520104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274138368:12345-0@lo:400: 00010000:00080000:3.0:1789175373.521677:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e726706a00 x1876086274138240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175373.521705:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789175373.521720:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789175373.522157:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789175373.522165:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789175373.522169:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e73fcaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789175373.522180:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274138240:0@lo:38: 00000100:00100000:1.0:1789175373.524964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274138368:12345-0@lo:400: Request processed in 4847us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175373.524982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1789175373.527129:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789175373.527499:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789175373.527542:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789175373.527570:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.527586:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789175373.527661:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789175373.527663:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789175373.527664:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175373.527666:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175373.527667:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175373.527668:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175373.527670:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175373.527671:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175373.527673:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175373.527674:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175373.527675:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789175373.527681:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789175373.527687:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789175373.527689:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789175373.527690:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175373.527691:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175373.527692:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175373.527693:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175373.527694:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175373.527695:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175373.527695:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175373.527696:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175373.527697:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789175373.527741:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789175373.527771:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274138496:0@lo:253: 00000100:00100000:3.0:1789175373.528123:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175373.528178:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc98540 going to sleep for 11 seconds 00000100:00100000:2.0:1789175373.528473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138496 00000100:00100000:2.0:1789175373.528485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138496 00000100:00100000:2.0:1789175373.528549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789175373.528561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6683:x1876086274138496:12345-0@lo:253: 20000000:01000000:2.0:1789175373.528597:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789175373.528629:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789175373.530509:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e7071d5f80 x1876086274138368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175373.530537:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274138368:0@lo:400: 20000000:01000000:1.0:1789175373.576916:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789175373.576947:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789175373.577131:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789175373.577137:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789175373.577166:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.577189:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.577210:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.577259:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.577274:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 13 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.577289:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274138624:0@lo:104: 00000100:00100000:2.0:1789175373.577387:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.577446:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7264c53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175373.577481:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138624 00000100:00100000:2.0:1789175373.577488:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138624 00000100:00100000:2.0:1789175373.577550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175373.577562:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274138624:12345-0@lo:104: 00010000:00010000:2.0:1789175373.577577:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.577648:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175373.577655:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274138624:12345-0@lo:104: Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.577662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175373.577670:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274138624:0@lo:104: 00010000:00010000:3.0:1789175373.577691:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.577907:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175373.577915:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.577938:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701526000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175373.577942:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.577950:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175373.577957:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175373.577963:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175373.578002:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.578009:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175373.578024:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.578031:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c163e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c163f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175373.578048:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175373.578051:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175373.578053:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175373.578532:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274138752:0@lo:103: 00000100:00100000:3.0:1789175373.578586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175373.580280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138752 00000100:00100000:2.0:1789175373.580297:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138752 00010000:00010000:2.0:1789175373.580365:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 14 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.580416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175373.580426:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711232850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:3304:x1876086274138752:12345-0@lo:103: 00010000:00010000:2.0:1789175373.580441:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175373.580447:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 14 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581143:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 14 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581165:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205f800/0x1112cdeac4c163f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c163e3 expref: 14 pid: 5830 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581187:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581207:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789175373.581227:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004090718s 00010000:00010000:2.0:1789175373.581233:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581253:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581261:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581268:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581275:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175373.581280:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581288:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581304:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175373.581327:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175373.581437:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711232850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3304:x1876086274138752:12345-0@lo:103: Request processed in 1012us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.581446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175373.581660:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274138752:0@lo:103: 00010000:00010000:3.0:1789175373.581699:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.581709:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175373.581715:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c16492 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175373.593979:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:6683:x1876086274138496:12345-0@lo:253: Request processed in 65411us (65847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175373.593997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789175373.594092:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6683:1876086274138496:0@lo:253: 10000000:01000000:3.0:1789175373.594125:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789175373.594128:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789175373.594131:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789175373.594132:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175373.594133:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175373.594134:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175373.594136:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175373.594138:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175373.594139:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789175373.594140:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789175373.594142:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175373.594144:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789175373.594159:0:6683:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789175373.598174:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175373.598558:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175373.598797:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175373.598990:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175373.599227:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175373.599731:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789175373.600948:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789175373.879967:0:6683:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789175373.879975:0:6683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789175373.880018:0:6683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789175373.880083:0:6683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789175373.880097:0:6683:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789175373.880122:0:6683:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789175374.305599:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175375.329506:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789175376.290439:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789175376.290447:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7201da000 from 21 10000000:01000000:2.0:1789175376.290452:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789175376.290504:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.290518:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.290529:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.290554:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274138880:0@lo:101: 00000100:00100000:2.0:1789175376.290645:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.290853:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.291130:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274138880 00000100:00100000:1.0:1789175376.291140:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274138880 00000100:00100000:1.0:1789175376.291246:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175376.291257:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274138880:12345-0@lo:101: 00010000:00010000:1.0:1789175376.291281:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175376.291294:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16499 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.291321:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.291330:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.291356:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205f000, rc 0) 00000100:00100000:1.0:1789175376.291413:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274138880:12345-0@lo:101: Request processed in 158us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.291420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789175376.294530:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274138880:0@lo:101: 00010000:00010000:2.0:1789175376.294566:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.294581:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.296024:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139008:0@lo:501: 00000100:00100000:2.0:1789175376.296108:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.296159:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.296391:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139008 00000100:00100000:1.0:1789175376.296399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139008 00000100:00100000:1.0:1789175376.296453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175376.296463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274139008:12345-0@lo:501: 00000100:00100000:1.0:1789175376.296941:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274139008:12345-0@lo:501: Request processed in 478us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.296950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789175376.297065:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139008:0@lo:501: 00000100:00100000:2.0:1789175376.297107:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139136:0@lo:503: 00000100:00100000:2.0:1789175376.297150:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.297180:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.297230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139136 00000100:00100000:1.0:1789175376.297235:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139136 00000100:00100000:1.0:1789175376.297681:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789175376.297691:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274139136:12345-0@lo:503: 00000100:00100000:1.0:1789175376.298030:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274139136:12345-0@lo:503: Request processed in 340us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.298044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789175376.303862:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139136:0@lo:503: 00000100:00100000:2.0:1789175376.304189:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6825:1876086274139264:0@lo:502: 00000100:00100000:2.0:1789175376.304268:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.304318:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139264 00000100:00100000:2.0:1789175376.304324:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139264 00000100:00100000:2.0:1789175376.304387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789175376.304397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6825:x1876086274139264:12345-0@lo:502: 00000100:00100000:2.0:1789175376.304799:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6825:x1876086274139264:12345-0@lo:502: Request processed in 401us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.304807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789175376.304853:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.304869:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6825:1876086274139264:0@lo:502: 00000100:00100000:2.0:1789175376.304912:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6825:1876086274139392:0@lo:502: 00000100:00100000:2.0:1789175376.304943:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.304959:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139392 00000100:00100000:2.0:1789175376.304963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139392 00000100:00100000:2.0:1789175376.304989:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789175376.304995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6825:x1876086274139392:12345-0@lo:502: 00000100:00100000:2.0:1789175376.305106:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:6825:x1876086274139392:12345-0@lo:502: Request processed in 110us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.305113:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789175376.305141:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.305152:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6825:1876086274139392:0@lo:502: 00000040:00080000:2.0:1789175376.305170:0:6825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789175376.305223:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789175376.305242:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789175376.305251:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305261:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175376.305299:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789175376.305303:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e7201da000 from 4 10000000:01000000:2.0:1789175376.305306:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789175376.305337:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305363:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305373:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.305385:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139520:0@lo:101: 00000100:00100000:2.0:1789175376.305420:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.305435:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.305447:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139520 00000100:00100000:2.0:1789175376.305450:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139520 00000100:00100000:2.0:1789175376.305471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789175376.305476:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274139520:12345-0@lo:101: 00010000:00010000:2.0:1789175376.305485:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175376.305497:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c164a7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305519:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305529:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305537:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1c00, rc 0) 00000100:00100000:2.0:1789175376.305567:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274139520:12345-0@lo:101: Request processed in 90us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.305572:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789175376.305602:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139520:0@lo:101: 00010000:00010000:2.0:1789175376.305615:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.305625:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.306046:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139648:0@lo:256: 00000100:00100000:2.0:1789175376.306083:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.306095:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.306107:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139648 00000100:00100000:2.0:1789175376.306110:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139648 00000100:00100000:2.0:1789175376.306127:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789175376.306133:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274139648:12345-0@lo:256: 20000000:01000000:2.0:1789175376.306145:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789175376.306161:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789175376.306165:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789175376.306241:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274139648:12345-0@lo:256: Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.306248:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789175376.306291:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139648:0@lo:256: 10000000:01000000:2.0:1789175376.306328:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789175376.306334:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306359:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175376.306367:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789175376.306369:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789175376.306371:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789175376.306390:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306397:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306415:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.306427:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139776:0@lo:101: 00000100:00100000:2.0:1789175376.306450:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.306463:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.306475:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139776 00000100:00100000:2.0:1789175376.306478:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139776 00000100:00100000:2.0:1789175376.306498:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789175376.306504:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274139776:12345-0@lo:101: 00010000:00010000:2.0:1789175376.306510:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175376.306519:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c164b5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306534:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306542:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306549:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a0000, rc 0) 00000100:00100000:2.0:1789175376.306575:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274139776:12345-0@lo:101: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.306581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789175376.306608:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139776:0@lo:101: 00010000:00010000:2.0:1789175376.306618:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175376.306636:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.307498:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139904:0@lo:501: 00000100:00100000:2.0:1789175376.307539:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.307568:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.307588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274139904 00000100:00100000:2.0:1789175376.307593:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274139904 00000100:00100000:2.0:1789175376.307623:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789175376.307631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274139904:12345-0@lo:501: 00000100:00100000:2.0:1789175376.307965:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274139904:12345-0@lo:501: Request processed in 334us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.307973:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789175376.308013:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274139904:0@lo:501: 00000100:00100000:2.0:1789175376.308041:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140032:0@lo:503: 00000100:00100000:2.0:1789175376.308080:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.308145:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.314212:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140032 00000100:00100000:1.0:1789175376.314228:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140032 00000100:00100000:1.0:1789175376.314484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789175376.314495:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274140032:12345-0@lo:503: 00000100:00100000:1.0:1789175376.317116:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274140032:12345-0@lo:503: Request processed in 2614us (9026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.317130:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789175376.329093:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140032:0@lo:503: 00000100:00100000:1.0:1789175376.348029:0:6828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6828:1876086274140160:0@lo:502: 00000100:00100000:1.0:1789175376.348140:0:6828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175376.348205:0:6828:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.348531:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140160 00000100:00100000:2.0:1789175376.348542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140160 00000100:00100000:2.0:1789175376.348596:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789175376.348606:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:6828:x1876086274140160:12345-0@lo:502: 00000100:00100000:2.0:1789175376.349100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:6828:x1876086274140160:12345-0@lo:502: Request processed in 494us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.349109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789175376.354866:0:6828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6828:1876086274140160:0@lo:502: 00000020:01000000:2.0:1789175376.354917:0:6828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789175376.354926:0:6828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789175376.354935:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175376.354937:0:6828:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789175376.354943:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789175376.354948:0:6828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:2.0:1789175376.354977:0:6828:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789175376.354980:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175376.354999:0:6828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97e7076d99c0) 00000020:00000080:2.0:1789175376.355022:0:6828:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789175376.355028:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789175376.359558:0:6828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789175376.360085:0:6828:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789175376.360103:0:6828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c164ca 00010000:00080000:2.0:1789175376.360158:0:6828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e7267e7000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175376.361784:0:6828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1789175376.363153:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789175376.414141:0:6828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789175376.414166:0:6828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789175376.414734:0:6828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175376.414888:0:6828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175376.414934:0:6828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789175376.414984:0:6828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789175376.415759:0:6832:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175376.415765:0:6832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789175376.416330:0:6828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789175376.416368:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789175376.416424:0:6828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789175376.416447:0:6828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c164d1 00000100:00080000:2.0:1789175376.416457:0:6828:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175376.416465:0:6828:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97e7267e7000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175376.416501:0:6828:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e7071d7480 x1876086274140288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789175376.416531:0:6828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789175376.416599:0:6828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175376.416604:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175376.416606:0:6828:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789175376.416609:0:6828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175376.416614:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175376.416617:0:6828:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789175376.416620:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789175376.416622:0:6828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789175376.416654:0:6828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6828:1876086274140416:0@lo:502: 00000100:00100000:2.0:1789175376.416730:0:6828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.416768:0:6828:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705127480 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.416893:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274140288:0@lo:8: 00000100:00100000:1.0:1789175376.416937:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175376.416983:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140416 00000100:00100000:1.0:1789175376.416989:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140416 00000100:00100000:1.0:1789175376.417031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789175376.417040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:6828:x1876086274140416:12345-0@lo:502: 00000100:00100000:3.0:1789175376.417259:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274140544:0@lo:400: 00000100:00100000:1.0:1789175376.417315:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:6828:x1876086274140416:12345-0@lo:502: Request processed in 275us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.417324:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789175376.417406:0:6828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:6828:1876086274140416:0@lo:502: 00000020:01000000:1.0:1789175376.417430:0:6828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175376.417435:0:6828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175376.417440:0:6828:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789175376.417445:0:6828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1789175376.417523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789175376.417562:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789175376.417581:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1789175376.417583:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274140672:0@lo:400: 00010000:00010000:1.0:1789175376.417591:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417604:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175376.417611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789175376.417622:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789175376.417625:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e7070799c0 from 1 10000000:01000000:1.0:1789175376.417629:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789175376.417653:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417662:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417672:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175376.417684:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140800:0@lo:101: 00000100:00100000:1.0:1789175376.417708:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175376.417722:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.417737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140800 00000100:00100000:1.0:1789175376.417740:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140800 00000100:00100000:1.0:1789175376.417758:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789175376.417765:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274140800:12345-0@lo:101: 00010000:00010000:1.0:1789175376.417773:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175376.417789:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c164d8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417811:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417822:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417831:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205e200, rc 0) 00000100:00100000:1.0:1789175376.417856:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274140800:12345-0@lo:101: Request processed in 91us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175376.417861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789175376.417885:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140800:0@lo:101: 00010000:00010000:1.0:1789175376.417897:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.417906:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175376.417943:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140928:0@lo:501: 00000100:00100000:1.0:1789175376.417962:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175376.417973:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175376.417985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140928 00000100:00100000:1.0:1789175376.417988:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140928 00000100:00100000:1.0:1789175376.418008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789175376.418010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140544 00000100:00100000:1.0:1789175376.418015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274140928:12345-0@lo:501: 00000100:00100000:3.0:1789175376.418017:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140544 00000100:00100000:3.0:1789175376.418053:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140672 00000100:00100000:3.0:1789175376.418056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140672 00000100:00100000:3.0:1789175376.418083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175376.418091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274140544:12345-0@lo:400: 00000100:00100000:3.0:1789175376.418132:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274140544:12345-0@lo:400: Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175376.418140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175376.418154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175376.418160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274140672:12345-0@lo:400: 00000100:00100000:3.0:1789175376.418189:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274140672:12345-0@lo:400: Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175376.418202:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789175376.418226:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175376.418239:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274140928:12345-0@lo:501: Request processed in 222us (273us total) trans 0 rc -2/-2 00010000:00080000:3.0:1789175376.418251:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d04e00 x1876086274140544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175376.418259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789175376.418281:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274140544:0@lo:400: 00000100:00100000:1.0:1789175376.418313:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274140928:0@lo:501: 10000000:01000000:1.0:1789175376.418331:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789175376.418336:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175376.418364:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175376.418521:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274140288 00000100:00100000:2.0:1789175376.418526:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274140288 00000100:00100000:2.0:1789175376.418553:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175376.418558:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876086274140288:12345-0@lo:8: 00010000:00080000:2.0:1789175376.418578:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1789175376.418601:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c164e6 00002000:00100000:2.0:1789175376.418642:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97e7267e3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789175376.418647:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789175376.418651:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789175376.418750:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789175376.418906:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789175376.418928:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e7267e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789175376.418971:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876086274140288:12345-0@lo:8: Request processed in 411us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.418977:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789175376.419187:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d04000 x1876086274140672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175376.419199:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274140672:0@lo:400: 00010000:00080000:1.0:1789175376.419369:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d7480 x1876086274140288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789175386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175376.419380:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789175376.419387:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789175376.419459:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789175376.419465:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789175376.419467:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e7267e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789175376.419527:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789175376.419533:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274140288:0@lo:8: 00000004:00080000:3.0:1789175376.422594:0:6832:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789175376.422887:0:6832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 161381544782ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789175376.469993:0:6833:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789175376.470028:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141184:0@lo:7: 00000100:00100000:0.0:1789175376.470081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274141056:0@lo:13: 00000100:00100000:2.0:1789175376.470112:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175376.470128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.470392:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff600 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.470416:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141184 00000100:00100000:2.0:1789175376.470424:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141184 00000100:00100000:2.0:1789175376.470481:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175376.470489:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6833:x1876086274141184:12345-0@lo:7: 00000100:00080000:0.0:1789175376.470506:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175376.478387:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141056 00000100:00100000:2.0:1789175376.478401:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141056 00000100:00100000:2.0:1789175376.478449:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175376.478459:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876086274141056:12345-0@lo:13: 00002000:00000024:2.0:1789175376.478492:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789175376.478575:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876086274141056:12345-0@lo:13: Request processed in 117us (8448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.478582:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789175376.478674:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d7b80 x1876086274141056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175376.478697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274141056:0@lo:13: 00002000:00080000:2.0:1789175376.479855:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789175376.479863:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789175376.479929:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6833:x1876086274141184:12345-0@lo:7: Request processed in 9438us (9816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175376.479939:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789175376.479986:0:6833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d4380 x1876086274141184/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789175392 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175376.479998:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141184:0@lo:7: 00000004:00080000:2.0:1789175376.480031:0:6833:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789175376.480072:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141312:0@lo:5: 00000100:00100000:2.0:1789175376.480105:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.480152:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70854e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.480166:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141312 00000100:00100000:2.0:1789175376.480171:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141312 00000100:00100000:2.0:1789175376.480208:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789175376.480216:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6833:x1876086274141312:12345-0@lo:5: 00002000:00080000:2.0:1789175376.480235:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789175376.480239:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789175376.480918:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6833:x1876086274141312:12345-0@lo:5: Request processed in 701us (810us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789175376.480926:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789175376.480955:0:6833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d4380 x1876086274141312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789175392 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175376.480968:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141312:0@lo:5: 00000004:00080000:2.0:1789175376.480976:0:6833:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789175376.481001:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141440:0@lo:700: 00000100:00100000:2.0:1789175376.481089:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175376.481109:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70854e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175376.481452:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141440 00000100:00100000:3.0:1789175376.481460:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141440 00000100:00100000:3.0:1789175376.481491:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175376.481499:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6833:x1876086274141440:12345-0@lo:700: 00000100:00100000:3.0:1789175376.481532:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1876086274141568:0@lo:700: 00000100:00100000:3.0:1789175376.481566:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175376.481587:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.481599:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141568 00000100:00100000:2.0:1789175376.481606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141568 00000100:00100000:2.0:1789175376.481705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175376.481714:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1876086274141568:12345-0@lo:700: 00000004:00080000:3.0:1789175376.510675:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789175376.592636:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789175376.598410:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1876086274141568:12345-0@lo:700: Request processed in 116686us (116831us total) trans 0 rc 0/0 00010000:00080000:3.0:1789175376.599577:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d04000 x1876086274141568/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789175392 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175376.599596:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1876086274141568:0@lo:700: 40000000:02000000:3.0:1789175376.599612:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789175376.601581:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1789175376.736505:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789175376.736531:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789175376.736806:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6833:x1876086274141440:12345-0@lo:700: Request processed in 255302us (255711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175376.736844:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789175376.736916:0:6833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d7800 x1876086274141440/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789175392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175376.736929:0:6833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789175376.736944:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141440:0@lo:700: 00000004:02000040:0.0:1789175376.764940:0:6833:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789175376.770574:0:6833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141696:0@lo:5: 00000100:00100000:1.0:1789175376.770668:0:6833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175376.770763:0:6833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e726522d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175376.774498:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141696 00000100:00100000:2.0:1789175376.774516:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141696 00000100:00100000:2.0:1789175376.774582:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175376.774594:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6833:x1876086274141696:12345-0@lo:5: 00002000:00080000:2.0:1789175376.781872:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789175376.781898:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789175376.785844:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6833:x1876086274141696:12345-0@lo:5: Request processed in 11242us (15167us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789175376.785860:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789175376.785935:0:6833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733f53480 x1876086274141696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789175392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175376.785968:0:6833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6833:1876086274141696:0@lo:5: 00000004:00080000:3.0:1789175376.785985:0:6833:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789175377.377642:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175378.403537:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175379.425548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175380.449530:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789175381.029154:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789175381.477853:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175381.929800:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274141824:0@lo:400: 00000100:00100000:3.0:1789175381.929888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175381.929956:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175381.929963:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274141952:0@lo:400: 00000100:00100000:3.0:1789175381.929992:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175381.930023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274142080:0@lo:400: 00000100:00100000:3.0:1789175381.930045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175381.930060:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175381.930065:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274142208:0@lo:400: 00000100:00100000:3.0:1789175381.930086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175381.930538:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141952 00000100:00100000:3.0:1789175381.930549:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141952 00000100:00100000:3.0:1789175381.930592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142080 00000100:00100000:3.0:1789175381.930595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142080 00000100:00100000:3.0:1789175381.930622:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175381.930632:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274141952:12345-0@lo:400: 00000100:00100000:3.0:1789175381.930691:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274141952:12345-0@lo:400: Request processed in 60us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175381.930698:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175381.930718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175381.930723:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274142080:12345-0@lo:400: 00000100:00100000:3.0:1789175381.930751:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274142080:12345-0@lo:400: Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175381.930769:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789175381.930792:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789175381.930821:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d07100 x1876086274142080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175381.930834:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274142080:0@lo:400: 00010000:00080000:3.0:1789175381.930865:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d06a00 x1876086274141952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175381.930873:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274141952:0@lo:400: 00000100:00100000:1.0:1789175381.933497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274141824 00000100:00100000:1.0:1789175381.933509:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274141824 00000100:00100000:1.0:1789175381.933564:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789175381.933574:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3304:x1876086274141824:12345-0@lo:400: 00000100:00100000:1.0:1789175381.933792:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3304:x1876086274141824:12345-0@lo:400: Request processed in 219us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175381.933800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789175381.933851:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142208 00000100:00100000:1.0:1789175381.933857:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142208 00000100:00100000:1.0:1789175381.933898:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175381.933906:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274142208:12345-0@lo:400: 00000100:00100000:1.0:1789175381.933952:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274142208:12345-0@lo:400: Request processed in 47us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175381.933959:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175381.934326:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175381.934803:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274142336:0@lo:13: 00000100:00100000:1.0:1789175381.934855:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175381.934954:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142336 00000100:00100000:1.0:1789175381.934960:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142336 00000100:00100000:1.0:1789175381.935003:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175381.935012:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274142336:12345-0@lo:13: 00002000:00000024:1.0:1789175381.935042:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175381.935080:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274142336:12345-0@lo:13: Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175381.935086:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789175381.935130:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733f53b80 x1876086274142336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175381.935150:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274142336:0@lo:13: 00000100:00080000:1.0:1789175381.935187:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789175381.935295:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d07480 x1876086274142208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175381.935307:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274142208:0@lo:400: 00000100:00100000:1.0:1789175381.936524:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274141824:0@lo:400: 00000001:00080000:1.0:1789175381.990224:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789175382.497618:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175383.521584:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175384.545477:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175385.573454:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175386.599521:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175387.041691:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274142464:0@lo:13: 00000100:00100000:3.0:1789175387.041774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175387.041875:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142464 00000100:00100000:3.0:1789175387.041882:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142464 00000100:00100000:3.0:1789175387.041938:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789175387.041948:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274142464:12345-0@lo:13: 00002000:00000024:3.0:1789175387.041985:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175387.042035:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274142464:12345-0@lo:13: Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175387.042042:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789175387.042071:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175387.042117:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733d06a00 x1876086274142464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175387.042129:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789175387.042151:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274142464:0@lo:13: 00000100:00100000:3.0:1789175387.042575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274142720:0@lo:400: 00000100:00100000:3.0:1789175387.042628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175387.042659:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175387.042665:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274142592:0@lo:400: 00000100:00100000:3.0:1789175387.042694:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175387.042776:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274142848:0@lo:400: 00000100:00100000:3.0:1789175387.042802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175387.042834:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142720 00000100:00100000:3.0:1789175387.042839:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142720 00000100:00100000:3.0:1789175387.042862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142848 00000100:00100000:3.0:1789175387.042865:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142848 00000100:00100000:3.0:1789175387.042882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175387.042888:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274142720:12345-0@lo:400: 00000100:00100000:3.0:1789175387.042927:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274142720:12345-0@lo:400: Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175387.042934:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175387.042951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175387.042958:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274142848:12345-0@lo:400: 00000100:00100000:3.0:1789175387.042992:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274142848:12345-0@lo:400: Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175387.043000:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789175387.043026:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789175387.043053:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e726705880 x1876086274142848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175387.043065:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274142848:0@lo:400: 00010000:00080000:3.0:1789175387.043105:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e726704380 x1876086274142720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175387.043129:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274142720:0@lo:400: 00000100:00100000:0.0:1789175387.045789:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142592 00000100:00100000:0.0:1789175387.045806:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142592 00000100:00100000:0.0:1789175387.045868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789175387.045880:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3307:x1876086274142592:12345-0@lo:400: 00000100:00100000:0.0:1789175387.045974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3307:x1876086274142592:12345-0@lo:400: Request processed in 96us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175387.045981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789175387.046135:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274142592:0@lo:400: 00010000:00010000:1.0:1789175387.618467:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175388.641921:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175389.665442:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175390.050895:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274143232:0@lo:400: 00000100:00100000:0.0:1789175390.050979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175390.051047:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175390.051054:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274143104:0@lo:400: 00000100:00100000:0.0:1789175390.051078:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175390.051111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143232 00000100:00100000:0.0:1789175390.051118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143232 00000100:00100000:0.0:1789175390.051172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143104 00000100:00100000:0.0:1789175390.051175:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143104 00000100:00100000:0.0:1789175390.051403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175390.051415:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274143232:12345-0@lo:400: 00000100:00100000:0.0:1789175390.051479:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274143232:12345-0@lo:400: Request processed in 66us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175390.051487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175390.051505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175390.051511:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274143104:12345-0@lo:400: 00000100:00100000:0.0:1789175390.051549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274143104:12345-0@lo:400: Request processed in 38us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175390.051556:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789175390.051578:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789175390.051612:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e726704380 x1876086274143104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175390.051629:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274143104:0@lo:400: 00010000:00080000:0.0:1789175390.051641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e726705880 x1876086274143232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175390.051650:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274143232:0@lo:400: 00000100:00100000:2.0:1789175390.051902:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274143360:0@lo:400: 00000100:00100000:2.0:1789175390.051941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175390.051983:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789175390.051990:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274142976:0@lo:400: 00000100:00100000:2.0:1789175390.052020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175390.052098:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143360 00000100:00100000:0.0:1789175390.052103:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143360 00000100:00100000:0.0:1789175390.052150:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175390.052157:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274143360:12345-0@lo:400: 00000100:00100000:0.0:1789175390.052376:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274143360:12345-0@lo:400: Request processed in 218us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175390.052383:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789175390.052415:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e726707480 x1876086274143360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175390.052426:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274143360:0@lo:400: 00000100:00080000:2.0:1789175390.052485:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175390.054222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274142976 00000100:00100000:1.0:1789175390.054235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274142976 00000100:00100000:1.0:1789175390.054294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789175390.054304:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3304:x1876086274142976:12345-0@lo:400: 00000100:00100000:1.0:1789175390.054416:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3304:x1876086274142976:12345-0@lo:400: Request processed in 113us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175390.054432:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789175390.054485:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274142976:0@lo:400: 00010000:00010000:1.0:1789175390.689473:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175391.713568:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175392.165631:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274143488:0@lo:13: 00000100:00100000:1.0:1789175392.165738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175392.165838:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143488 00000100:00100000:3.0:1789175392.165848:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143488 00000100:00100000:3.0:1789175392.165927:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789175392.166101:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175392.166192:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274143488:12345-0@lo:13: 00002000:00000024:3.0:1789175392.166233:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175392.166659:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274143488:12345-0@lo:13: Request processed in 469us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175392.166670:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789175392.166823:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e733f53b80 x1876086274143488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175392.166850:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274143488:0@lo:13: 00010000:00010000:1.0:1789175392.737460:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175393.762198:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789175394.080843:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789175394.080859:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789175394.080990:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e7264f7000 00000020:01000004:0.0:1789175394.081007:0:7628:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789175394.081021:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789175394.081036:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97e726674d40) 00000020:00000080:0.0:1789175394.081057:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789175394.123545:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789175394.123835:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789175394.145889:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789175394.156581:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789175394.156625:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789175394.156685:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789175394.156714:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789175394.158369:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789175394.158385:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789175394.158400:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1112cdeac4c164f4 00000020:01000004:3.0:1789175394.158410:0:7628:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789175394.158436:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789175394.158440:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789175394.158446:0:7628:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789175394.158552:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789175394.158557:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789175394.204753:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789175394.204810:0:7628:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789175394.204815:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789175394.204817:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789175394.204818:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175394.204819:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175394.204821:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175394.204822:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175394.204824:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175394.204825:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789175394.204826:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789175394.204828:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175394.204830:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789175394.204834:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789175394.204836:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789175394.204838:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789175394.204839:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175394.204840:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175394.204841:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175394.204842:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175394.204844:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175394.204845:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789175394.204846:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789175394.204847:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175394.204848:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789175394.204896:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789175394.204918:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274143616:0@lo:253: 00000100:00100000:2.0:1789175394.206200:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.206333:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175394.209274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143616 00000100:00100000:3.0:1789175394.209291:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143616 00000100:00100000:3.0:1789175394.209449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789175394.210223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:7628:x1876086274143616:12345-0@lo:253: 20000000:01000000:3.0:1789175394.210266:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789175394.210270:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789175394.210276:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789175394.210280:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789175394.212923:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175394.216910:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789175394.216944:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789175394.217052:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789175394.217064:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789175394.218330:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789175394.218565:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789175394.219055:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789175394.220023:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:2.0:1789175394.220031:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:2.0:1789175394.220214:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789175394.220230:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789175394.220294:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789175394.220302:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:2.0:1789175394.220336:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789175394.220446:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789175394.220564:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789175394.220622:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789175394.224284:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789175394.224545:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:2.0:1789175394.224549:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:2.0:1789175394.224647:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789175394.224656:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789175394.224689:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789175394.224696:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:2.0:1789175394.224724:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789175394.224734:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789175394.224803:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789175394.224847:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789175394.224871:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789175394.224874:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789175394.224882:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789175394.224883:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789175394.224886:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789175394.224902:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789175394.224905:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789175394.224955:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789175394.224968:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789175394.232621:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789175394.232727:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789175394.232786:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789175394.233333:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789175394.233436:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789175394.234302:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789175394.234328:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789175394.234381:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789175394.246869:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789175394.247016:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789175394.247052:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789175394.253306:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789175394.253817:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789175394.253900:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789175394.253922:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789175394.253924:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789175394.254876:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789175394.254941:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789175394.255012:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789175394.255633:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789175394.255693:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789175394.255979:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789175394.255994:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789175394.255997:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789175394.256956:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789175394.257315:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789175394.257633:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789175394.257705:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1789175394.257830:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789175394.257851:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257873:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257882:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257889:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257896:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257902:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257922:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257978:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.257996:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 16 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.258012:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274143744:0@lo:104: 00000100:00100000:3.0:1789175394.258225:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175394.258329:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.258337:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 16 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.258387:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274143872:0@lo:104: 00010000:00010000:3.0:1789175394.258420:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.258428:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.258434:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144000:0@lo:104: 00010000:00010000:3.0:1789175394.258469:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.258476:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 16 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.258493:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144128:0@lo:104: 00010000:00010000:3.0:1789175394.258524:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.258533:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 16 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.258541:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144256:0@lo:104: 00000100:00100000:3.0:1789175394.258578:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175394.265223:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789175394.265281:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.265323:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.265388:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.265403:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.265420:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143744 00000100:00100000:3.0:1789175394.265431:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143744 00000100:00100000:3.0:1789175394.265665:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274143872 00000100:00100000:3.0:1789175394.265669:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274143872 00000100:00100000:3.0:1789175394.265679:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144000 00000100:00100000:3.0:1789175394.265681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144000 00000100:00100000:3.0:1789175394.265689:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144128 00000100:00100000:3.0:1789175394.265691:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144128 00000100:00100000:3.0:1789175394.265698:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144256 00000100:00100000:3.0:1789175394.265700:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144256 00000100:00100000:3.0:1789175394.265712:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175394.265733:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7200cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:5833:x1876086274143744:12345-0@lo:104: 00010000:00010000:3.0:1789175394.265756:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.265855:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789175394.265863:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7200cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:5833:x1876086274143744:12345-0@lo:104: Request processed in 142us (7639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.265870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175394.265909:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175394.265915:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5833:x1876086274143872:12345-0@lo:104: 00010000:00010000:3.0:1789175394.265923:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.265954:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789175394.265975:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:5833:x1876086274143872:12345-0@lo:104: Request processed in 44us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.265981:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175394.265993:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175394.265999:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:5833:x1876086274144000:12345-0@lo:104: 00010000:00010000:3.0:1789175394.266006:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.266039:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789175394.266044:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:5833:x1876086274144000:12345-0@lo:104: Request processed in 46us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.266050:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175394.266059:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789175394.266065:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5833:x1876086274144128:12345-0@lo:104: 00010000:00010000:3.0:1789175394.266071:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.266270:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274143744:0@lo:104: 00000100:00100000:2.0:1789175394.266281:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274143872:0@lo:104: 00000100:00100000:2.0:1789175394.266287:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144000:0@lo:104: 00010000:00010000:3.0:1789175394.268311:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789175394.268321:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5833:x1876086274144128:12345-0@lo:104: Request processed in 2254us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.268333:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175394.268491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175394.268505:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5833:x1876086274144256:12345-0@lo:104: 00010000:00010000:0.0:1789175394.268520:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268559:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789175394.268563:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:5833:x1876086274144256:12345-0@lo:104: Request processed in 64us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.268568:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789175394.268622:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789175394.268629:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268636:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205f800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.268640:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268649:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.268657:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.268663:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.268733:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268739:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.268759:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268766:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c164d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268783:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789175394.268787:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268792:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.268795:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268801:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.268807:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.268812:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.268825:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268831:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.268835:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268852:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c164b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268862:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789175394.268865:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268869:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.268872:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268879:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.268886:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.268891:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.268905:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268910:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.268924:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268930:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c16499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268938:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175394.268945:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268951:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.268954:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.268995:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.269002:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.269008:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.269022:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269028:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.269032:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269038:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c1646f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16476 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269047:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175394.269050:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269054:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701527600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.269057:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269072:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.269079:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.269095:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.269109:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269115:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.269119:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269126:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701527600/0x1112cdeac4c16445 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1644c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.269143:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.269145:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.269152:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175394.269176:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144512:0@lo:103: 00000100:00100000:0.0:1789175394.269222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.269265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789175394.269270:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144384:0@lo:103: 00000100:00100000:0.0:1789175394.269290:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.269314:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144896:0@lo:103: 00000100:00100000:0.0:1789175394.269332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.269416:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274144640:0@lo:103: 00000100:00100000:0.0:1789175394.269440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.269455:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175394.269460:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274144768:0@lo:103: 00000100:00100000:0.0:1789175394.269481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.269512:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144512 00000100:00100000:0.0:1789175394.269521:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144512 00010000:00010000:0.0:1789175394.269554:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 17 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175394.269577:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144384 00000100:00100000:0.0:1789175394.269580:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144384 00010000:00010000:0.0:1789175394.269591:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 18 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175394.269601:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144896 00000100:00100000:0.0:1789175394.269604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144896 00010000:00010000:0.0:1789175394.269615:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 19 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175394.269624:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144640 00000100:00100000:0.0:1789175394.269627:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144640 00010000:00010000:0.0:1789175394.269637:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 20 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175394.269646:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274144768 00000100:00100000:0.0:1789175394.269648:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274144768 00010000:00010000:0.0:1789175394.269660:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 21 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175394.269672:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789175394.269678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+21:3307:x1876086274144512:12345-0@lo:103: 00010000:00010000:0.0:1789175394.269715:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.269722:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 21 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269733:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 21 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269749:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0000/0x1112cdeac4c164bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c164b5 expref: 21 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269766:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.269800:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3307:x1876086274144512:12345-0@lo:103: Request processed in 121us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.269806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789175394.269823:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789175394.269829:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274144384:12345-0@lo:103: 00010000:00010000:0.0:1789175394.269837:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.269842:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 19 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269852:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 19 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269861:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c164df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c164d8 expref: 19 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269872:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.269892:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3307:x1876086274144384:12345-0@lo:103: Request processed in 63us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.269898:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789175394.269916:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789175394.269921:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3307:x1876086274144896:12345-0@lo:103: 00010000:00010000:0.0:1789175394.269928:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.269933:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 17 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269942:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 17 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.269952:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.269989:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3307:x1876086274144896:12345-0@lo:103: Request processed in 68us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.269994:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789175394.270007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175394.270013:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3304:x1876086274144640:12345-0@lo:103: 00010000:00010000:0.0:1789175394.270020:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.270024:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270033:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270043:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205f000/0x1112cdeac4c164a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16499 expref: 16 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270053:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.270077:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:3304:x1876086274144640:12345-0@lo:103: Request processed in 64us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.270082:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175394.270100:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175394.270107:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:3304:x1876086274144768:12345-0@lo:103: 00010000:00010000:0.0:1789175394.270114:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.270119:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 14 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270129:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 14 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270144:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270153:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270170:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270178:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270185:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270192:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270199:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701526000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175394.270204:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270212:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270229:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.270239:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.270264:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:3304:x1876086274144768:12345-0@lo:103: Request processed in 157us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.270270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175394.270318:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274144768:0@lo:103: 00000100:00100000:0.0:1789175394.270326:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274144640:0@lo:103: 00000100:00100000:0.0:1789175394.270379:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144384:0@lo:103: 00000100:00100000:0.0:1789175394.270386:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144896:0@lo:103: 00000100:00100000:0.0:1789175394.270394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274144512:0@lo:103: 00010000:00010000:0.0:1789175394.270432:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.270440:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175394.272304:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e701527000/0x1112cdeac4c16476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1646f expref: 13 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.272331:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144128:0@lo:104: 00010000:00010000:2.0:1789175394.272373:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205f200/0x1112cdeac4c1644c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16445 expref: 12 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.272384:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1876086274144256:0@lo:104: 00010000:00010000:2.0:1789175394.272421:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.272433:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.272439:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.272479:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e701526000/0x1112cdeac4c164fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789175394.272503:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789175394.422473:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:7628:x1876086274143616:12345-0@lo:253: Request processed in 212250us (216269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.422489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789175394.425583:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274143616:0@lo:253: 10000000:01000000:2.0:1789175394.425610:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789175394.425614:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789175394.425616:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789175394.425618:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175394.425619:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789175394.425621:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175394.425622:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175394.425624:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175394.425625:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789175394.425627:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175394.425628:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789175394.425660:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e7264f7000 from lustre-OST0001 10000000:01000000:2.0:1789175394.425697:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789175394.425700:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789175394.425711:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e7070799c0 local copy 10000000:01000000:2.0:1789175394.426604:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789175394.426680:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.426696:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.426710:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.427052:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145024:0@lo:101: 00000100:00100000:2.0:1789175394.427246:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.427418:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175394.431247:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145024 00000100:00100000:0.0:1789175394.431266:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145024 00000100:00100000:1.0:1789175394.435565:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789175394.435586:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+11:7628:x1876086274145024:12345-0@lo:101: 00010000:00010000:1.0:1789175394.435608:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175394.435636:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16502 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.435671:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16502 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.435687:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16502 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.435698:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205fe00, rc 0) 00000100:00100000:1.0:1789175394.436614:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145024:12345-0@lo:101: Request processed in 1028us (9361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.436625:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789175394.436837:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145024:0@lo:101: 00010000:00010000:2.0:1789175394.436858:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.436872:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.437662:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145152:0@lo:501: 00000100:00100000:2.0:1789175394.438934:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.439200:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.439546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145152 00000100:00100000:1.0:1789175394.439579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145152 00000100:00100000:1.0:1789175394.439800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175394.439811:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145152:12345-0@lo:501: 00000100:00100000:1.0:1789175394.441266:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145152:12345-0@lo:501: Request processed in 1449us (3536us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789175394.441280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789175394.441857:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145152:0@lo:501: 10000000:01000000:2.0:1789175394.441882:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789175394.441931:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789175394.441940:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.441951:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.442231:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.442310:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789175394.442381:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e7264f7000 10000000:01000000:2.0:1789175394.442388:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789175394.442395:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789175394.442410:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789175394.442416:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789175394.442419:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789175394.442462:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.442471:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.442482:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.442506:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145280:0@lo:101: 00000100:00100000:2.0:1789175394.442563:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.442598:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.444624:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145280 00000100:00100000:1.0:1789175394.444644:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145280 00000100:00100000:1.0:1789175394.444757:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789175394.444770:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145280:12345-0@lo:101: 00010000:00010000:1.0:1789175394.444793:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175394.444817:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16510 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.444853:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.444867:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.444878:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205f000, rc 0) 00000100:00100000:1.0:1789175394.444988:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274145280:12345-0@lo:101: Request processed in 221us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.444995:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789175394.445429:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145280:0@lo:101: 00010000:00010000:3.0:1789175394.445588:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.445600:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.445758:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145408:0@lo:501: 00000100:00100000:3.0:1789175394.445804:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.445834:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.447392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145408 00000100:00100000:1.0:1789175394.447407:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145408 00000100:00100000:1.0:1789175394.447707:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789175394.447835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274145408:12345-0@lo:501: 00000100:00100000:1.0:1789175394.449609:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274145408:12345-0@lo:501: Request processed in 1878us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.449639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789175394.450391:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145408:0@lo:501: 00000100:00100000:3.0:1789175394.450626:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145536:0@lo:503: 00000100:00100000:3.0:1789175394.450716:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.451008:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789175394.453684:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175394.453701:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.453713:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175394.453728:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.453740:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175394.453775:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175394.453781:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175394.453829:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.453836:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175394.453883:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.453891:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1112cdeac4c16509 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.453910:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.453912:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175394.453914:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175394.454128:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175394.454153:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274145664:0@lo:103: 00000100:00100000:3.0:1789175394.454230:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.454499:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145664 00000100:00100000:0.0:1789175394.454508:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145664 00000100:00100000:0.0:1789175394.454559:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175394.454567:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3306:x1876086274145664:12345-0@lo:103: 00010000:00010000:0.0:1789175394.454581:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175394.454597:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16502 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.454614:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175394.454657:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:3306:x1876086274145664:12345-0@lo:103: Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.454665:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789175394.454900:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274145664:0@lo:103: 00000100:00100000:2.0:1789175394.457264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145536 00000100:00100000:2.0:1789175394.457283:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145536 00000100:00100000:2.0:1789175394.457905:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789175394.457923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145536:12345-0@lo:503: 00000100:00100000:2.0:1789175394.458284:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145536:12345-0@lo:503: Request processed in 368us (7567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175394.458291:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789175394.458478:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145536:0@lo:503: 00000040:00080000:3.0:1789175394.458865:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789175394.458983:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145792:0@lo:502: 00000100:00100000:3.0:1789175394.459046:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.469567:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.470200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145792 00000100:00100000:1.0:1789175394.470213:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145792 00000100:00100000:2.0:1789175394.470590:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789175394.470606:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145792:12345-0@lo:502: 00000100:00100000:2.0:1789175394.470940:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145792:12345-0@lo:502: Request processed in 337us (11892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175394.470948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789175394.471316:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145792:0@lo:502: 00000040:00080000:3.0:1789175394.471781:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789175394.471839:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789175394.471882:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789175394.471925:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789175394.471978:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789175394.472011:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789175394.472049:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145920:0@lo:502: 00000100:00100000:3.0:1789175394.472192:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.481775:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175394.483885:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274145920 00000100:00100000:0.0:1789175394.483906:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274145920 00000100:00100000:0.0:1789175394.484675:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789175394.484688:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145920:12345-0@lo:502: 00000100:00100000:0.0:1789175394.485029:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274145920:12345-0@lo:502: Request processed in 343us (12836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.485037:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789175394.485714:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274145920:0@lo:502: 00000040:00080000:3.0:1789175394.485918:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789175394.485935:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789175394.487841:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789175394.487854:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789175394.487861:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175394.487863:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789175394.487869:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789175394.487889:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97e726b819c0) 00000020:00000080:3.0:1789175394.487913:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789175394.487919:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789175394.488587:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7264f7000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789175394.488598:0:7635:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789175394.488608:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1112cdeac4c16525 00010000:00010000:3.0:1789175394.503248:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789175394.504233:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789175394.525988:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789175394.527574:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789175394.536943:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789175394.550672:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789175394.562801:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789175394.562819:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175394.562827:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175394.562829:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789175394.562833:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175394.562838:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175394.562839:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789175394.562842:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789175394.562844:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789175394.562917:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175394.562920:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175394.562922:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789175394.562926:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789175394.568241:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789175394.568291:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789175394.568335:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.568405:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175394.568415:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7264f7000 from 1 10000000:01000000:3.0:1789175394.568417:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175394.568466:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.568475:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.568486:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.568511:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146048:0@lo:101: 00000100:00100000:3.0:1789175394.568605:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.568655:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.568848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146048 00000100:00100000:1.0:1789175394.568860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146048 00000100:00100000:1.0:1789175394.568922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789175394.568932:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:7628:x1876086274146048:12345-0@lo:101: 00010000:00010000:1.0:1789175394.568946:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175394.568968:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1652c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.568995:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.569007:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.569017:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205e200, rc 0) 00000100:00100000:1.0:1789175394.569057:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146048:12345-0@lo:101: Request processed in 127us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.569064:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789175394.569313:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146048:0@lo:101: 00010000:00010000:3.0:1789175394.569329:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.569372:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.569488:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146176:0@lo:501: 00000100:00100000:3.0:1789175394.569516:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.569557:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.569710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146176 00000100:00100000:1.0:1789175394.569715:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146176 00000100:00100000:1.0:1789175394.569748:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789175394.569755:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146176:12345-0@lo:501: 00000100:00100000:1.0:1789175394.570007:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146176:12345-0@lo:501: Request processed in 252us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.570014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789175394.570096:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146176:0@lo:501: 00000100:00100000:0.0:1789175394.570130:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146304:0@lo:503: 00000100:00100000:0.0:1789175394.570177:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.570215:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.570568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146304 00000100:00100000:1.0:1789175394.570573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146304 00000100:00100000:1.0:1789175394.570611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789175394.570620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146304:12345-0@lo:503: 00000100:00100000:1.0:1789175394.570940:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146304:12345-0@lo:503: Request processed in 321us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.570948:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789175394.571029:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146304:0@lo:503: 00000040:00080000:1.0:1789175394.573914:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789175394.574045:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146432:0@lo:502: 00000100:00100000:1.0:1789175394.575300:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175394.575406:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baad780 going to sleep for 11 seconds 00000100:00100000:0.0:1789175394.588234:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146432 00000100:00100000:0.0:1789175394.588250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146432 00000100:00100000:0.0:1789175394.590093:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789175394.590119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146432:12345-0@lo:502: 00000100:00100000:0.0:1789175394.590678:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146432:12345-0@lo:502: Request processed in 569us (15379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.590688:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789175394.590870:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146432:0@lo:502: 00000040:00080000:1.0:1789175394.593585:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789175394.593692:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789175394.593747:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146560:0@lo:502: 00000100:00100000:1.0:1789175394.593836:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175394.603811:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baad780 going to sleep for 11 seconds 00000100:00100000:3.0:1789175394.604561:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146560 00000100:00100000:3.0:1789175394.604575:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146560 00000100:00100000:3.0:1789175394.604634:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789175394.604645:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146560:12345-0@lo:502: 00000100:00100000:3.0:1789175394.604964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146560:12345-0@lo:502: Request processed in 309us (11116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.604972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789175394.605492:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146560:0@lo:502: 00000040:00080000:1.0:1789175394.605700:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789175394.605720:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789175394.606892:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789175394.606906:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175394.606915:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789175394.606923:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7264f7000 00000020:00000080:1.0:1789175394.606925:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789175394.606947:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175394.606950:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175394.606964:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789175394.606968:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789175394.609209:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789175394.609258:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175394.609295:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.609310:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175394.609410:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789175394.609414:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e7264f7000 10000000:01000000:3.0:1789175394.609417:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e7264f7000 10000000:01000000:3.0:1789175394.609422:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175394.609430:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7264f7000 from 1 10000000:01000000:3.0:1789175394.609433:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789175394.609476:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.609485:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.609498:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.609546:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146688:0@lo:101: 00000100:00100000:3.0:1789175394.609631:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.609678:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac000 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.609839:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146688 00000100:00100000:1.0:1789175394.609847:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146688 00000100:00100000:1.0:1789175394.609899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789175394.609910:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274146688:12345-0@lo:101: 00010000:00010000:1.0:1789175394.609923:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175394.609936:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1653a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.609973:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.609985:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.609995:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205f200, rc 0) 00000100:00100000:1.0:1789175394.610038:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274146688:12345-0@lo:101: Request processed in 130us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.610044:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789175394.611663:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146688:0@lo:101: 00010000:00010000:3.0:1789175394.611694:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175394.611709:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.611879:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146816:0@lo:501: 00000100:00100000:3.0:1789175394.611938:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.612018:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1789175394.612046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146816 00000100:00100000:3.0:1789175394.612053:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146816 00000100:00100000:3.0:1789175394.612547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789175394.612561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274146816:12345-0@lo:501: 00000100:00100000:3.0:1789175394.612876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274146816:12345-0@lo:501: Request processed in 318us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.612884:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789175394.612984:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146816:0@lo:501: 00000100:00100000:0.0:1789175394.613028:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146944:0@lo:503: 00000100:00100000:0.0:1789175394.613073:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.618630:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789175394.618910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274146944 00000100:00100000:2.0:1789175394.618920:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274146944 00000100:00100000:2.0:1789175394.619000:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789175394.619010:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274146944:12345-0@lo:503: 00000100:00100000:2.0:1789175394.619822:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274146944:12345-0@lo:503: Request processed in 808us (6743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175394.619833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789175394.620661:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274146944:0@lo:503: 00000040:00080000:2.0:1789175394.621064:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789175394.621247:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147072:0@lo:502: 00000100:00100000:2.0:1789175394.621306:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.621489:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175394.621590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147072 00000100:00100000:3.0:1789175394.621596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147072 00000100:00100000:0.0:1789175394.621653:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789175394.621702:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274147072:12345-0@lo:502: 00000100:00100000:2.0:1789175394.621933:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274147072:12345-0@lo:502: Request processed in 271us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175394.621941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789175394.622043:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147072:0@lo:502: 00000040:00080000:2.0:1789175394.624794:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789175394.624905:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789175394.624945:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789175394.625014:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789175394.625049:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789175394.625263:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789175394.625302:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789175394.625331:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789175394.625532:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789175394.625565:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789175394.625595:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789175394.625645:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789175394.625683:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789175394.625736:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789175394.625789:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789175394.625826:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789175394.625861:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789175394.625910:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789175394.625945:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789175394.625993:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789175394.626039:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789175394.626150:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789175394.626190:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789175394.626233:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789175394.626263:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789175394.626291:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789175394.626333:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789175394.626569:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789175394.626601:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789175394.626670:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789175394.626703:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789175394.626730:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789175394.626758:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789175394.626800:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789175394.626836:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789175394.626884:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789175394.626920:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789175394.627050:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147200:0@lo:502: 00000100:00100000:2.0:1789175394.627224:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.627437:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175394.627579:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147200 00000100:00100000:0.0:1789175394.627588:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147200 00000100:00100000:0.0:1789175394.627702:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789175394.627714:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274147200:12345-0@lo:502: 00000100:00100000:0.0:1789175394.628011:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274147200:12345-0@lo:502: Request processed in 297us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175394.628020:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789175394.628125:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147200:0@lo:502: 00000040:00080000:2.0:1789175394.628229:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789175394.628244:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789175394.629433:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789175394.629469:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97e73be2cd40) 00000020:00000080:2.0:1789175394.629498:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789175394.629583:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7264f7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789175394.629587:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7264f7000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789175394.629590:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7264f7000 3 00010000:00080000:2.0:1789175394.629621:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e73bbab800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175394.631523:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789175394.631732:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789175394.631771:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789175394.631784:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1112cdeac4c1654f 00000100:00080000:2.0:1789175394.631796:0:7640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175394.631804:0:7640:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97e73bbab800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175394.631844:0:7640:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e7071d6680 x1876086274147328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789175394.631865:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789175394.634425:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274147328:0@lo:38: 00000100:00100000:1.0:1789175394.634522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175394.634622:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147328 00000100:00100000:1.0:1789175394.634632:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147328 00000100:00100000:1.0:1789175394.634676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789175394.634693:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274147328:12345-0@lo:38: 00010000:00080000:1.0:1789175394.634726:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1789175394.634768:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1112cdeac4c16556 00000004:00100000:1.0:1789175394.634783:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789175394.634819:0:5838:0:(import.c:65:import_set_state_nolock()) ffff97e737dd9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175394.634869:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876086274147328:12345-0@lo:38: Request processed in 175us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.634876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789175394.635053:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d6680 x1876086274147328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175394.635065:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789175394.635075:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789175394.635082:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789175394.635087:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789175394.635090:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e73bbab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789175394.635095:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274147328:0@lo:38: 00000100:00100000:3.0:1789175394.636368:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274147456:0@lo:400: 00000100:00100000:3.0:1789175394.636434:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.636469:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175394.636475:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274147584:0@lo:400: 00000100:00100000:3.0:1789175394.636508:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.636540:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274147712:0@lo:400: 00000100:00100000:3.0:1789175394.636570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175394.636617:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147456 00000100:00100000:3.0:1789175394.636624:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147456 00000100:00100000:3.0:1789175394.636664:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147584 00000100:00100000:3.0:1789175394.636667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147584 00000100:00100000:3.0:1789175394.636697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789175394.636706:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274147456:12345-0@lo:400: 00000100:00100000:3.0:1789175394.636759:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274147456:12345-0@lo:400: Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.636767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789175394.636783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789175394.636789:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274147584:12345-0@lo:400: 00000100:00100000:3.0:1789175394.636818:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274147584:12345-0@lo:400: Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.636824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789175394.636853:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147712 00000100:00100000:3.0:1789175394.636856:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147712 00000100:00100000:3.0:1789175394.636888:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789175394.636895:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274147712:12345-0@lo:400: 00000100:00100000:3.0:1789175394.636931:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274147712:12345-0@lo:400: Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.636937:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789175394.636973:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789175394.636978:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789175394.637007:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e734265500 x1876086274147584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175394.637031:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274147584:0@lo:400: 00010000:00080000:3.0:1789175394.637044:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e734267480 x1876086274147456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175394.637052:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274147456:0@lo:400: 00010000:00080000:3.0:1789175394.637238:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e734267b80 x1876086274147712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175394.637248:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274147712:0@lo:400: 00000040:00080000:3.0:1789175394.637724:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789175394.638219:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1876086274147840:0@lo:901: 00000100:00100000:2.0:1789175394.638273:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789175394.638335:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789175394.638404:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789175394.638420:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175394.638433:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789175394.638488:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789175394.638493:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789175394.638494:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789175394.638495:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789175394.638496:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789175394.638497:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789175394.638498:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789175394.638499:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789175394.638501:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789175394.638502:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789175394.638503:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789175394.638508:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789175394.638510:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789175394.638512:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789175394.638512:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789175394.638513:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789175394.638514:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789175394.638515:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789175394.638516:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789175394.638516:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789175394.638517:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789175394.638518:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789175394.638519:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789175394.638534:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789175394.638542:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147968:0@lo:253: 00000100:00100000:0.0:1789175394.638595:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175394.638644:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.638883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147968 00000100:00100000:1.0:1789175394.638890:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147968 00000100:00100000:1.0:1789175394.638927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789175394.638935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:7628:x1876086274147968:12345-0@lo:253: 20000000:01000000:1.0:1789175394.638968:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789175394.638984:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789175394.639221:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175394.642039:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274147840 00000100:00100000:2.0:1789175394.642056:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274147840 00000100:00100000:2.0:1789175394.642210:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175394.642221:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1876086274147840:12345-0@lo:901: 00000100:00100000:2.0:1789175394.642703:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1876086274147840:12345-0@lo:901: Request processed in 483us (4427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175394.642713:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789175394.643681:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789175394.643729:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e7071d6680 x1876086274147840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789175410 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175394.643748:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1876086274147840:0@lo:901: 20000000:01000000:3.0:1789175394.688812:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789175394.688834:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789175394.688972:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789175394.688979:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789175394.689004:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.689023:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.689033:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.689089:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.689105:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.689119:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274148096:0@lo:104: 00000100:00100000:2.0:1789175394.689193:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175394.689242:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175394.689368:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148096 00000100:00100000:1.0:1789175394.689376:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148096 00000100:00100000:1.0:1789175394.689425:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789175394.689434:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274148096:12345-0@lo:104: 00010000:00010000:1.0:1789175394.689466:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689525:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789175394.689532:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:5854:x1876086274148096:12345-0@lo:104: Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.689540:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789175394.689566:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175394.689573:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689581:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175394.689586:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689596:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175394.689605:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175394.689611:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789175394.689642:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689650:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789175394.689669:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689677:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0e00/0x1112cdeac4c164a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c164ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689705:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175394.689707:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175394.689709:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175394.689728:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274148224:0@lo:103: 00000100:00100000:1.0:1789175394.689759:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175394.689806:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148224 00000100:00100000:1.0:1789175394.689810:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148224 00010000:00010000:1.0:1789175394.689828:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 15 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175394.689852:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789175394.689859:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711231850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:3307:x1876086274148224:12345-0@lo:103: 00010000:00010000:1.0:1789175394.689870:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175394.689875:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 15 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689886:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 15 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689902:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689911:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789175394.689924:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004090718s 00010000:00010000:1.0:1789175394.689928:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689946:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689966:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689973:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689979:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175394.689983:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.689992:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.690002:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175394.690013:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175394.690041:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711231850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:3307:x1876086274148224:12345-0@lo:103: Request processed in 182us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175394.690048:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789175394.690119:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274148224:0@lo:103: 00010000:00010000:2.0:1789175394.690394:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c164ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c164a7 expref: 14 pid: 5832 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175394.690407:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1876086274148096:0@lo:104: 00010000:00010000:2.0:1789175394.690422:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.690433:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.690440:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175394.690455:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c1655d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175394.698743:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:7628:x1876086274147968:12345-0@lo:253: Request processed in 59797us (60135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175394.698761:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789175394.698907:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:7628:1876086274147968:0@lo:253: 10000000:01000000:0.0:1789175394.698925:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789175394.698929:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789175394.698931:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789175394.698932:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789175394.698934:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789175394.698935:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789175394.698937:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789175394.698939:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789175394.698940:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789175394.698942:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789175394.698944:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789175394.698971:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789175394.698989:0:7628:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789175394.703976:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789175394.704333:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789175394.704684:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789175394.704847:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789175394.705314:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789175394.705727:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789175394.707657:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789175394.800589:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789175395.069019:0:7628:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789175395.069028:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789175395.069084:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789175395.069157:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789175395.069181:0:7628:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789175395.069214:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789175395.809520:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175396.834244:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175397.282475:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274148352:0@lo:13: 00000100:00100000:3.0:1789175397.282582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175397.283220:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148352 00000100:00100000:0.0:1789175397.283233:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148352 00000100:00100000:0.0:1789175397.283329:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789175397.283362:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274148352:12345-0@lo:13: 00002000:00000024:0.0:1789175397.283408:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175397.283490:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274148352:12345-0@lo:13: Request processed in 152us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175397.283498:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789175397.283549:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726707480 x1876086274148352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175397.283575:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274148352:0@lo:13: 00000100:00080000:3.0:1789175397.283707:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789175397.858714:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175398.881519:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175399.844882:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274148864:0@lo:400: 00000100:00100000:1.0:1789175399.844962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175399.845127:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789175399.845134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274148480:0@lo:400: 00000100:00100000:1.0:1789175399.845173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175399.845193:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274148992:0@lo:400: 00000100:00100000:1.0:1789175399.845217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175399.845245:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274148608:0@lo:400: 00000100:00100000:1.0:1789175399.845285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175399.845300:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175399.845305:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274148736:0@lo:400: 00000100:00100000:1.0:1789175399.845329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175399.846092:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148992 00000100:00100000:3.0:1789175399.846104:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148992 00000100:00100000:3.0:1789175399.846187:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148608 00000100:00100000:3.0:1789175399.846191:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148608 00000100:00100000:3.0:1789175399.846207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148736 00000100:00100000:3.0:1789175399.846210:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148736 00000100:00100000:3.0:1789175399.846229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175399.846240:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274148992:12345-0@lo:400: 00000100:00100000:3.0:1789175399.846320:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274148992:12345-0@lo:400: Request processed in 81us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175399.846407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175399.846428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175399.846434:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274148608:12345-0@lo:400: 00000100:00100000:3.0:1789175399.846468:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274148608:12345-0@lo:400: Request processed in 35us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175399.846475:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175399.846486:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175399.846491:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274148736:12345-0@lo:400: 00000100:00100000:3.0:1789175399.846517:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274148736:12345-0@lo:400: Request processed in 26us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175399.846523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789175399.846552:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789175399.846843:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f52300 x1876086274148992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175399.846870:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274148992:0@lo:400: 00000100:00100000:3.0:1789175399.846936:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148864 00000100:00100000:3.0:1789175399.846941:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148864 00000100:00100000:3.0:1789175399.846980:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175399.846987:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274148864:12345-0@lo:400: 00000100:00100000:3.0:1789175399.847029:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274148864:12345-0@lo:400: Request processed in 42us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175399.847037:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789175399.847054:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175399.847072:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f50a80 x1876086274148864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175399.847096:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274148864:0@lo:400: 00000100:00100000:0.0:1789175399.847380:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274148480 00000100:00100000:0.0:1789175399.847410:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274148480 00000100:00100000:0.0:1789175399.847440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789175399.847447:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3304:x1876086274148480:12345-0@lo:400: 00000100:00100000:0.0:1789175399.847494:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:3304:x1876086274148480:12345-0@lo:400: Request processed in 47us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175399.847500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789175399.847546:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274148480:0@lo:400: 00010000:00080000:1.0:1789175399.847591:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f50000 x1876086274148736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175399.847603:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274148736:0@lo:400: 00010000:00080000:1.0:1789175399.847617:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f50e00 x1876086274148608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175399.847624:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274148608:0@lo:400: 00010000:00010000:3.0:1789175399.905519:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175400.931366:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175401.960487:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789175402.071594:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789175402.401786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175402.401837:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274149120:0@lo:13: 00000100:00100000:3.0:1789175402.401925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175402.402215:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149120 00000100:00100000:0.0:1789175402.402224:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149120 00000100:00100000:0.0:1789175402.402303:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789175402.402313:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274149120:12345-0@lo:13: 00002000:00000024:0.0:1789175402.402374:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175402.402429:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274149120:12345-0@lo:13: Request processed in 117us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.402437:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789175402.402481:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726707480 x1876086274149120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175402.402503:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274149120:0@lo:13: 00000100:00080000:3.0:1789175402.402734:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789175402.914401:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789175402.914409:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e73c3b2800 from 30 10000000:01000000:1.0:1789175402.914414:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789175402.914461:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.914474:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.914485:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175402.914523:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149248:0@lo:101: 00000100:00100000:1.0:1789175402.914594:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.914643:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.917161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149248 00000100:00100000:0.0:1789175402.917178:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149248 00000100:00100000:0.0:1789175402.917235:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789175402.917247:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274149248:12345-0@lo:101: 00010000:00010000:0.0:1789175402.917263:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175402.917281:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16564 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.917332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.917357:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.917367:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031a00, rc 0) 00000100:00100000:0.0:1789175402.917452:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149248:12345-0@lo:101: Request processed in 207us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.917458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789175402.917471:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149248:0@lo:101: 00010000:00010000:1.0:1789175402.917491:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.917501:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175402.917575:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149376:0@lo:501: 00000100:00100000:1.0:1789175402.917615:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.919977:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175402.920114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149376 00000100:00100000:3.0:1789175402.920124:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149376 00000100:00100000:3.0:1789175402.920181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789175402.920190:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149376:12345-0@lo:501: 00000100:00100000:3.0:1789175402.921075:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149376:12345-0@lo:501: Request processed in 882us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.921081:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149376:0@lo:501: 00000100:00100000:3.0:1789175402.921086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789175402.921136:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149504:0@lo:503: 00000100:00100000:1.0:1789175402.921190:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175402.921265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149504 00000100:00100000:3.0:1789175402.921270:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149504 00000100:00100000:1.0:1789175402.921306:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175402.922986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789175402.922998:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149504:12345-0@lo:503: 00000100:00100000:3.0:1789175402.923376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149504:12345-0@lo:503: Request processed in 379us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175402.923385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789175402.923430:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149504:0@lo:503: 00000100:00100000:2.0:1789175402.926702:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8047:1876086274149632:0@lo:502: 00000100:00100000:2.0:1789175402.927158:0:8047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.927249:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1789175402.927291:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149632 00000100:00100000:3.0:1789175402.927299:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149632 00000100:00100000:3.0:1789175402.927583:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789175402.927593:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8047:x1876086274149632:12345-0@lo:502: 00000100:00100000:3.0:1789175402.928136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8047:x1876086274149632:12345-0@lo:502: Request processed in 542us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175402.928150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789175402.928241:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8047:1876086274149632:0@lo:502: 00000100:00100000:2.0:1789175402.928310:0:8047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8047:1876086274149760:0@lo:502: 00000100:00100000:2.0:1789175402.928367:0:8047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.928606:0:8047:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.928646:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149760 00000100:00100000:0.0:1789175402.928651:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149760 00000100:00100000:0.0:1789175402.928679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789175402.928686:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8047:x1876086274149760:12345-0@lo:502: 00000100:00100000:0.0:1789175402.929040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8047:x1876086274149760:12345-0@lo:502: Request processed in 353us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.929046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789175402.929165:0:8047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8047:1876086274149760:0@lo:502: 00000040:00080000:2.0:1789175402.929184:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789175402.929257:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789175402.929274:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789175402.929284:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929295:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175402.929313:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789175402.929315:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789175402.929318:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789175402.929377:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929384:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929391:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175402.929405:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149888:0@lo:101: 00000100:00100000:1.0:1789175402.929434:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.929449:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.929461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274149888 00000100:00100000:1.0:1789175402.929464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274149888 00000100:00100000:1.0:1789175402.929480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789175402.929485:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274149888:12345-0@lo:101: 00010000:00010000:1.0:1789175402.929493:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175402.929505:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16572 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929526:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929535:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929551:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e74205fe00, rc 0) 00000100:00100000:1.0:1789175402.929576:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274149888:12345-0@lo:101: Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.929581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789175402.929606:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274149888:0@lo:101: 00010000:00010000:1.0:1789175402.929616:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.929624:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175402.929657:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150016:0@lo:501: 00000100:00100000:1.0:1789175402.929677:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.929759:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.929769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150016 00000100:00100000:1.0:1789175402.929772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150016 00000100:00100000:1.0:1789175402.929869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789175402.929875:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274150016:12345-0@lo:501: 00000100:00100000:1.0:1789175402.930119:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274150016:12345-0@lo:501: Request processed in 243us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.930126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789175402.931009:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150016:0@lo:501: 00000100:00100000:2.0:1789175402.931050:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150144:0@lo:503: 00000100:00100000:2.0:1789175402.931096:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.931159:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.931189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150144 00000100:00100000:0.0:1789175402.931193:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150144 00000100:00100000:0.0:1789175402.931226:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789175402.931232:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274150144:12345-0@lo:503: 00000100:00100000:0.0:1789175402.931713:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274150144:12345-0@lo:503: Request processed in 478us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.931721:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789175402.936263:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150144:0@lo:503: 00000100:00100000:2.0:1789175402.938034:0:8049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8049:1876086274150272:0@lo:502: 00000100:00100000:2.0:1789175402.938202:0:8049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.938252:0:8049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.938315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150272 00000100:00100000:0.0:1789175402.938323:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150272 00000100:00100000:0.0:1789175402.938394:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789175402.938410:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8049:x1876086274150272:12345-0@lo:502: 00000100:00100000:0.0:1789175402.938683:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8049:x1876086274150272:12345-0@lo:502: Request processed in 274us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.938691:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789175402.939058:0:8049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8049:1876086274150272:0@lo:502: 00000020:01000000:2.0:1789175402.939090:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175402.939099:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175402.939106:0:8049:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789175402.939112:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789175402.939114:0:8049:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789175402.939134:0:8049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8049:1876086274150400:0@lo:502: 00000100:00100000:2.0:1789175402.939167:0:8049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.939195:0:8049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.939776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150400 00000100:00100000:0.0:1789175402.940032:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150400 00000100:00100000:0.0:1789175402.940091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789175402.940101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8049:x1876086274150400:12345-0@lo:502: 00000100:00100000:0.0:1789175402.940314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8049:x1876086274150400:12345-0@lo:502: Request processed in 215us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.940322:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789175402.940833:0:8049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8049:1876086274150400:0@lo:502: 00000020:01000000:2.0:1789175402.940868:0:8049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175402.940875:0:8049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175402.940877:0:8049:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789175402.940882:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789175402.941481:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789175402.941507:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789175402.941519:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.941532:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175402.941545:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789175402.941547:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7201da000 from 30 10000000:01000000:0.0:1789175402.941551:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789175402.941582:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.941591:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.941601:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175402.941629:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150528:0@lo:101: 00000100:00100000:0.0:1789175402.941677:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175402.941715:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1789175402.942204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150528 00000100:00100000:2.0:1789175402.942211:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150528 00000100:00100000:2.0:1789175402.942252:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789175402.942260:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274150528:12345-0@lo:101: 00010000:00010000:2.0:1789175402.942273:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175402.942287:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16580 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.942310:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.942321:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.942329:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a0c00, rc 0) 00000100:00100000:2.0:1789175402.942386:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274150528:12345-0@lo:101: Request processed in 126us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175402.942393:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789175402.942432:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150528:0@lo:101: 00010000:00010000:2.0:1789175402.942450:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.942460:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.942506:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150656:0@lo:501: 00000100:00100000:2.0:1789175402.942530:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.942549:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175402.942560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150656 00000100:00100000:2.0:1789175402.942564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150656 00000100:00100000:2.0:1789175402.942582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789175402.942587:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274150656:12345-0@lo:501: 00000100:00100000:2.0:1789175402.942854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274150656:12345-0@lo:501: Request processed in 266us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175402.942862:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789175402.942887:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150656:0@lo:501: 00000100:00100000:2.0:1789175402.942911:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150784:0@lo:503: 00000100:00100000:2.0:1789175402.943393:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.943421:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175402.943434:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150784 00000100:00100000:2.0:1789175402.943438:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150784 00000100:00100000:2.0:1789175402.943465:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789175402.943472:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274150784:12345-0@lo:503: 00000100:00100000:2.0:1789175402.943626:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274150784:12345-0@lo:503: Request processed in 154us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175402.943633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789175402.943678:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274150784:0@lo:503: 00000100:00100000:3.0:1789175402.953194:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8050:1876086274150912:0@lo:502: 00000100:00100000:3.0:1789175402.953269:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175402.953308:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.953309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274150912 00000100:00100000:1.0:1789175402.953315:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274150912 00000100:00100000:1.0:1789175402.953646:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789175402.953657:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8050:x1876086274150912:12345-0@lo:502: 00000100:00100000:1.0:1789175402.953979:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8050:x1876086274150912:12345-0@lo:502: Request processed in 323us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.953992:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789175402.954033:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8050:1876086274150912:0@lo:502: 00000100:00100000:0.0:1789175402.954093:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8050:1876086274151040:0@lo:502: 00000100:00100000:0.0:1789175402.954128:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175402.954161:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.954179:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151040 00000100:00100000:1.0:1789175402.954183:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151040 00000100:00100000:1.0:1789175402.954214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789175402.954221:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8050:x1876086274151040:12345-0@lo:502: 00000100:00100000:1.0:1789175402.954326:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8050:x1876086274151040:12345-0@lo:502: Request processed in 105us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.954332:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789175402.954368:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8050:1876086274151040:0@lo:502: 00000040:00080000:0.0:1789175402.954387:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789175402.954532:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789175402.954549:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789175402.954558:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.954567:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175402.954574:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789175402.954682:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e7201da000 from 5 10000000:01000000:2.0:1789175402.954685:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789175402.954711:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.954720:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.954730:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.954743:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151168:0@lo:101: 00000100:00100000:2.0:1789175402.954766:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175402.954992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151168 00000100:00100000:3.0:1789175402.954997:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151168 00000100:00100000:3.0:1789175402.955020:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789175402.955024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274151168:12345-0@lo:101: 00010000:00010000:3.0:1789175402.955031:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175402.955042:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e701527000/0x1112cdeac4c16595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1658e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175402.955058:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e701527000/0x1112cdeac4c16595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1658e expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175402.955066:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e701527000/0x1112cdeac4c16595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1658e expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175402.955072:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e701527000, rc 0) 00000100:00100000:3.0:1789175402.955091:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274151168:12345-0@lo:101: Request processed in 67us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175402.955095:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789175402.955151:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789175402.955161:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151168:0@lo:101: 00010000:00010000:2.0:1789175402.955170:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.955177:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.955213:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151296:0@lo:256: 00000100:00100000:2.0:1789175402.955232:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.955247:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.955269:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151296 00000100:00100000:1.0:1789175402.955273:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151296 00000100:00100000:1.0:1789175402.955295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789175402.955302:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274151296:12345-0@lo:256: 20000000:01000000:1.0:1789175402.955314:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789175402.955330:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789175402.955333:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789175402.955432:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274151296:12345-0@lo:256: Request processed in 130us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175402.955437:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151296:0@lo:256: 00000100:00100000:1.0:1789175402.955439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 10000000:01000000:2.0:1789175402.955474:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789175402.955480:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.955488:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175402.955495:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789175402.955497:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789175402.955499:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789175402.955513:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.955518:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.955524:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.955530:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151424:0@lo:101: 00000100:00100000:2.0:1789175402.955547:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.955589:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.955627:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151424 00000100:00100000:0.0:1789175402.955630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151424 00000100:00100000:0.0:1789175402.955675:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789175402.955680:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274151424:12345-0@lo:101: 00010000:00010000:0.0:1789175402.955686:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175402.955696:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1659c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.955711:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.955718:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.955725:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700030800, rc 0) 00000100:00100000:0.0:1789175402.956019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274151424:12345-0@lo:101: Request processed in 338us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.956030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789175402.956068:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151424:0@lo:101: 00010000:00010000:2.0:1789175402.956079:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175402.956084:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.956115:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151552:0@lo:501: 00000100:00100000:2.0:1789175402.956132:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.956146:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.956167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151552 00000100:00100000:1.0:1789175402.956171:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151552 00000100:00100000:1.0:1789175402.956192:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789175402.956198:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274151552:12345-0@lo:501: 00000100:00100000:1.0:1789175402.956417:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274151552:12345-0@lo:501: Request processed in 219us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.956424:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789175402.956497:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151552:0@lo:501: 00000100:00100000:2.0:1789175402.956517:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151680:0@lo:503: 00000100:00100000:2.0:1789175402.956544:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.956562:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.956602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151680 00000100:00100000:0.0:1789175402.956604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151680 00000100:00100000:0.0:1789175402.956649:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789175402.956653:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274151680:12345-0@lo:503: 00000100:00100000:0.0:1789175402.957072:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274151680:12345-0@lo:503: Request processed in 418us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175402.957077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789175402.957127:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274151680:0@lo:503: 00000100:00100000:2.0:1789175402.957437:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8051:1876086274151808:0@lo:502: 00000100:00100000:2.0:1789175402.957467:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.957490:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.957497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151808 00000100:00100000:1.0:1789175402.957501:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151808 00000100:00100000:1.0:1789175402.957528:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789175402.957535:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8051:x1876086274151808:12345-0@lo:502: 00000100:00100000:1.0:1789175402.957764:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8051:x1876086274151808:12345-0@lo:502: Request processed in 229us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.957771:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789175402.957915:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8051:1876086274151808:0@lo:502: 00000020:01000000:2.0:1789175402.957946:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789175402.957953:0:8051:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789175402.957958:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175402.957959:0:8051:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789175402.957963:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789175402.957966:0:8051:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:2.0:1789175402.957984:0:8051:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789175402.957986:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175402.958002:0:8051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97e73be2b380) 00000020:00000080:2.0:1789175402.958019:0:8051:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789175402.958022:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789175402.958092:0:8051:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789175402.958096:0:8051:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789175402.958102:0:8051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c165b1 00010000:00080000:2.0:1789175402.958125:0:8051:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e734454800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175402.958294:0:8051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789175402.958573:0:8051:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789175402.958582:0:8051:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789175402.959201:0:8051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175402.959410:0:8051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175402.959453:0:8051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789175402.959496:0:8051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789175402.959762:0:8052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789175402.959767:0:8052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789175402.960892:0:8051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789175402.960905:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789175402.960935:0:8051:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789175402.960958:0:8051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c165b8 00000100:00080000:1.0:1789175402.960969:0:8051:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789175402.960976:0:8051:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e734454800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175402.961011:0:8051:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e733f50000 x1876086274151936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789175402.961031:0:8051:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789175402.961058:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274151936:0@lo:8: 00000020:01000000:1.0:1789175402.961094:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175402.961098:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175402.961100:0:8051:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789175402.961103:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789175402.961106:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175402.961108:0:8051:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789175402.961110:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789175402.961112:0:8051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789175402.961134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.961135:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8051:1876086274152064:0@lo:502: 00000100:00100000:1.0:1789175402.961177:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175402.961191:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274151936 00000100:00100000:2.0:1789175402.961197:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274151936 00000100:00100000:1.0:1789175402.961198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152064 00000100:00100000:1.0:1789175402.961201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152064 00000100:00100000:2.0:1789175402.961226:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789175402.961227:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789175402.961234:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876086274151936:12345-0@lo:8: 00000100:00100000:1.0:1789175402.961234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8051:x1876086274152064:12345-0@lo:502: 00010000:00080000:2.0:1789175402.961258:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1789175402.961282:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c165bf 00002000:00100000:2.0:1789175402.961295:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97e734450000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789175402.961299:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789175402.961303:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789175402.961437:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789175402.961474:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8051:x1876086274152064:12345-0@lo:502: Request processed in 239us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.961487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789175402.961529:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.961547:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8051:1876086274152064:0@lo:502: 00000020:01000000:1.0:1789175402.961573:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00002000:00080000:2.0:1789175402.961575:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:00000080:1.0:1789175402.961576:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175402.961578:0:8051:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789175402.961582:0:8051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:2.0:1789175402.961600:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e734452000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1789175402.961628:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1789175402.961632:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876086274151936:12345-0@lo:8: Request processed in 398us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175402.961638:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:1.0:1789175402.961643:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789175402.961652:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.961665:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789175402.961672:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f50000 x1876086274151936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789175412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789175402.961675:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789175402.961677:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e7070799c0 from 1 10000000:01000000:1.0:1789175402.961680:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1789175402.961681:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789175402.961689:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789175402.961698:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789175402.961703:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789175402.961705:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e734454800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:1.0:1789175402.961706:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175402.961713:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:1.0:1789175402.961714:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175402.961717:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274151936:0@lo:8: 00010000:00010000:1.0:1789175402.961723:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175402.961734:0:8052:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789175402.961735:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274152192:0@lo:101: 00000100:00100000:1.0:1789175402.961758:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.961779:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55240 going to sleep for 11 seconds 00000100:00100000:1.0:1789175402.962061:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274152320:0@lo:400: 00000100:00100000:3.0:1789175402.962079:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274152576:0@lo:400: 00000100:00100000:1.0:1789175402.962090:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175402.962105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175402.962121:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175402.962127:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274152448:0@lo:400: 00000100:00100000:3.0:1789175402.962145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.962173:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152320 00000100:00100000:1.0:1789175402.962178:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152320 00000100:00100000:3.0:1789175402.962180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152576 00000100:00100000:3.0:1789175402.962182:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152576 00000100:00100000:1.0:1789175402.962200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152448 00000100:00100000:1.0:1789175402.962202:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152448 00000100:00100000:3.0:1789175402.962206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175402.962213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274152320:12345-0@lo:400: 00000100:00100000:1.0:1789175402.962215:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789175402.962220:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789175402.962252:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274152320:12345-0@lo:400: Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175402.962258:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175402.962270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789175402.962275:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274152576:12345-0@lo:400: 00000100:00100000:3.0:1789175402.962300:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274152576:12345-0@lo:400: Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.962301:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789175402.962305:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789175402.962307:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274152448:12345-0@lo:400: 00000100:00080000:3.0:1789175402.962323:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175402.962334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274152448:12345-0@lo:400: Request processed in 28us (189us total) trans 0 rc 0/0 00010000:00080000:3.0:1789175402.962361:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734265180 x1876086274152320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175402.962364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789175402.962372:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274152320:0@lo:400: 00010000:00080000:3.0:1789175402.962393:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734265c00 x1876086274152448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175402.962401:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274152448:0@lo:400: 00010000:00080000:3.0:1789175402.962410:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734266680 x1876086274152576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175402.962418:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274152576:0@lo:400: 00000100:00100000:0.0:1789175402.962541:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152192 00000100:00100000:0.0:1789175402.962545:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152192 00000100:00100000:0.0:1789175402.962569:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789175402.962577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274152192:12345-0@lo:101: 00010000:00010000:0.0:1789175402.962585:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175402.962597:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c165c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.962617:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.962628:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175402.962637:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031600, rc 0) 00000100:00100000:0.0:1789175402.962671:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274152192:12345-0@lo:101: Request processed in 95us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175402.962676:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274152192:0@lo:101: 00000100:00100000:0.0:1789175402.962677:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:1.0:1789175402.962764:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.962846:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175402.962894:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274152704:0@lo:501: 00000100:00100000:1.0:1789175402.962919:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175402.962942:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55240 going to sleep for 11 seconds 00000100:00100000:0.0:1789175402.962988:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152704 00000100:00100000:0.0:1789175402.962993:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152704 00000100:00100000:0.0:1789175402.963020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789175402.963025:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274152704:12345-0@lo:501: 00000100:00100000:0.0:1789175402.963213:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274152704:12345-0@lo:501: Request processed in 187us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175402.963220:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789175402.963232:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274152704:0@lo:501: 10000000:01000000:1.0:1789175402.963251:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789175402.963258:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175402.963274:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175402.965278:0:8052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 187923934555ns, next at 0ns, rc = 0 00010000:00010000:1.0:1789175402.977472:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175403.008607:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274152832:0@lo:13: 00000100:00100000:3.0:1789175403.008684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789175403.008769:0:8053:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789175403.009182:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152832 00000100:00100000:0.0:1789175403.009197:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152832 00000100:00100000:3.0:1789175403.010499:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274152960:0@lo:7: 00000100:00100000:3.0:1789175403.010570:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175403.010606:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e707ee43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175403.010615:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274152960 00000100:00100000:1.0:1789175403.010622:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274152960 00000100:00100000:0.0:1789175403.010733:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789175403.010751:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876086274152832:12345-0@lo:13: 00002000:00000024:0.0:1789175403.010788:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789175403.010832:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789175403.010843:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8053:x1876086274152960:12345-0@lo:7: 00000100:00100000:0.0:1789175403.010865:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876086274152832:12345-0@lo:13: Request processed in 121us (2179us total) trans 0 rc 0/0 00000100:00080000:3.0:1789175403.010912:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175403.012179:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789175403.012335:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734266680 x1876086274152832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175403.012387:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274152832:0@lo:13: 00002000:00080000:1.0:1789175403.015522:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789175403.015532:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789175403.015641:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8053:x1876086274152960:12345-0@lo:7: Request processed in 4796us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175403.015654:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789175403.015781:0:8053:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734265180 x1876086274152960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789175419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175403.015797:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274152960:0@lo:7: 00000004:00080000:0.0:1789175403.015822:0:8053:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789175403.015859:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153088:0@lo:5: 00000100:00100000:0.0:1789175403.015890:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175403.015951:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7181e7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175403.015980:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153088 00000100:00100000:3.0:1789175403.015986:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153088 00000100:00100000:3.0:1789175403.016049:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175403.016060:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8053:x1876086274153088:12345-0@lo:5: 00002000:00080000:3.0:1789175403.016084:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789175403.016088:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789175403.016369:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8053:x1876086274153088:12345-0@lo:5: Request processed in 310us (476us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789175403.016376:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789175403.017634:0:8053:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704380 x1876086274153088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789175419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175403.017647:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153088:0@lo:5: 00000004:00080000:2.0:1789175403.017659:0:8053:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789175403.017690:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153216:0@lo:700: 00000100:00100000:2.0:1789175403.022490:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175403.022542:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7395ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1789175403.022544:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153216 00000100:00100000:1.0:1789175403.022555:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153216 00000100:00100000:1.0:1789175403.022614:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175403.022625:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8053:x1876086274153216:12345-0@lo:700: 00000100:00100000:1.0:1789175403.022696:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1876086274153344:0@lo:700: 00000100:00100000:1.0:1789175403.022751:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175403.022862:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71470d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175403.022928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153344 00000100:00100000:2.0:1789175403.022932:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153344 00000100:00100000:2.0:1789175403.022965:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175403.022974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1876086274153344:12345-0@lo:700: 00000004:00080000:3.0:1789175403.032939:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789175403.053020:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789175403.056562:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1876086274153344:12345-0@lo:700: Request processed in 33580us (33802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175403.056577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789175403.056589:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f50e00 x1876086274153344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789175419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175403.056608:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1876086274153344:0@lo:700: 40000000:02000000:0.0:1789175403.056622:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1789175403.100182:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789175403.100196:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789175403.100308:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8053:x1876086274153216:12345-0@lo:700: Request processed in 77680us (77819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175403.100321:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789175403.100361:0:8053:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e7071d7100 x1876086274153216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789175419 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175403.100376:0:8053:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789175403.100399:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153216:0@lo:700: 00000004:02000040:0.0:1789175403.114208:0:8053:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789175403.116918:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153472:0@lo:5: 00000100:00100000:1.0:1789175403.117016:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175403.117112:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175403.117179:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153472 00000100:00100000:2.0:1789175403.117186:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153472 00000100:00100000:2.0:1789175403.117238:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789175403.117247:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8053:x1876086274153472:12345-0@lo:5: 00002000:00080000:1.0:1789175403.126906:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789175403.126925:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789175403.129725:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8053:x1876086274153472:12345-0@lo:5: Request processed in 12470us (12699us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789175403.129738:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789175403.129976:0:8053:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704700 x1876086274153472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789175419 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175403.129995:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8053:1876086274153472:0@lo:5: 00000004:00080000:2.0:1789175403.130009:0:8053:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789175404.003633:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175405.025557:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175406.049903:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175406.423326:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789175406.949428:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175406.949537:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251061376 00000100:00100000:2.0:1789175406.949547:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251061376 00000100:00100000:2.0:1789175406.949597:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:2.0:1789175406.949606:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1876086251061376:12345-192.168.201.18@tcp:250: 00010000:00080000:2.0:1789175406.949636:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b713f2ef-bd6e-4338-b8a1-2540482274c5@192.168.201.18@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1789175406.949683:0:5830:0:(genops.c:1385:class_connect()) connect: client b713f2ef-bd6e-4338-b8a1-2540482274c5, cookie 0x1112cdeac4c165d4 00000100:00080000:2.0:1789175406.949829:0:5830:0:(import.c:65:import_set_state_nolock()) ffff97e734453800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789175406.949901:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+5:2352:x1876086251061376:12345-192.168.201.18@tcp:250: Request processed in 294us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175406.949909:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:2.0:1789175406.967260:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175406.968117:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251061504 00000100:00100000:3.0:1789175406.968131:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251061504 00000100:00100000:3.0:1789175406.968212:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1789175406.968234:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+5:5582:x1876086251061504:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1789175406.968252:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175406.968273:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2a5d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175406.968307:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175406.968928:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175406.968940:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9c00, rc 0) 00000100:00100000:3.0:1789175406.969019:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+6:5582:x1876086251061504:12345-192.168.201.18@tcp:101: Request processed in 796us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175406.969027:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:2.0:1789175406.972458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175406.972564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251061632 00000100:00100000:1.0:1789175406.972575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251061632 00000100:00100000:1.0:1789175406.972635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:1.0:1789175406.972645:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+6:5582:x1876086251061632:12345-192.168.201.18@tcp:501: 00000100:00100000:1.0:1789175406.973093:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+6:5582:x1876086251061632:12345-192.168.201.18@tcp:501: Request processed in 447us (643us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789175406.973102:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:0.0:1789175406.976603:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175406.976711:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251061760 00000100:00100000:2.0:1789175406.976753:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251061760 00000100:00100000:2.0:1789175406.976817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1789175406.976827:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+6:5582:x1876086251061760:12345-192.168.201.18@tcp:101: 00010000:00010000:2.0:1789175406.976847:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175406.977087:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2a64 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175406.977122:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175406.977132:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175406.977142:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1e00, rc 0) 00000100:00100000:2.0:1789175406.977454:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+7:5582:x1876086251061760:12345-192.168.201.18@tcp:101: Request processed in 626us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175406.977461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1789175406.984032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175406.984112:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251061888 00000100:00100000:3.0:1789175406.984122:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251061888 00000100:00100000:3.0:1789175406.984245:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1789175406.984255:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+7:5582:x1876086251061888:12345-192.168.201.18@tcp:501: 00000100:00100000:3.0:1789175406.984567:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5582:x1876086251061888:12345-192.168.201.18@tcp:501: Request processed in 312us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175406.984575:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:2.0:1789175406.987811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175406.988179:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062016 00000100:00100000:0.0:1789175406.988191:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062016 00000100:00100000:0.0:1789175406.988248:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:0.0:1789175406.988258:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5582:x1876086251062016:12345-192.168.201.18@tcp:503: 00000100:00100000:0.0:1789175406.988639:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5582:x1876086251062016:12345-192.168.201.18@tcp:503: Request processed in 381us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175406.988648:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:2.0:1789175406.991648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175406.992095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062144 00000100:00100000:3.0:1789175406.992107:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062144 00000100:00100000:2.0:1789175406.992386:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1789175406.992399:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5600:x1876086251062144:12345-192.168.201.18@tcp:502: 00000100:00100000:2.0:1789175406.992819:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5600:x1876086251062144:12345-192.168.201.18@tcp:502: Request processed in 420us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175406.992829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:0.0:1789175407.009129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175407.009566:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062272 00000100:00100000:3.0:1789175407.009580:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062272 00000100:00100000:3.0:1789175407.009641:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:3.0:1789175407.009652:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5600:x1876086251062272:12345-192.168.201.18@tcp:502: 00000100:00100000:3.0:1789175407.010163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5600:x1876086251062272:12345-192.168.201.18@tcp:502: Request processed in 511us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175407.010247:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:2.0:1789175407.015472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175407.015535:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062400 00000100:00100000:2.0:1789175407.015553:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062400 00000100:00100000:2.0:1789175407.015619:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:2.0:1789175407.015631:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5582:x1876086251062400:12345-192.168.201.18@tcp:101: 00010000:00010000:2.0:1789175407.015652:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175407.015678:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c165e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2a8e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175407.015714:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c165e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a8e expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175407.015729:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c165e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a8e expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175407.015749:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a0e00, rc 0) 00000100:00100000:2.0:1789175407.015812:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5582:x1876086251062400:12345-192.168.201.18@tcp:101: Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175407.015820:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:3.0:1789175407.020024:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175407.020062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062528 00000100:00100000:3.0:1789175407.020081:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062528 00000100:00100000:3.0:1789175407.020130:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1789175407.020139:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5582:x1876086251062528:12345-192.168.201.18@tcp:256: 20000000:01000000:3.0:1789175407.020176:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789175407.020193:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789175407.020197:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789175407.020200:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789175407.020202:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789175407.027087:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5582:x1876086251062528:12345-192.168.201.18@tcp:256: Request processed in 6936us (7062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.027105:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1789175407.034247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175407.035550:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062656 00000100:00100000:0.0:1789175407.035567:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062656 00000100:00100000:0.0:1789175407.035631:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:0.0:1789175407.035642:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5582:x1876086251062656:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1789175407.035661:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175407.035680:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2a95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175407.035823:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175407.035835:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175407.035846:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031000, rc 0) 00000100:00100000:0.0:1789175407.036299:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5582:x1876086251062656:12345-192.168.201.18@tcp:101: Request processed in 658us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.036308:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1789175407.040639:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175407.040701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062784 00000100:00100000:0.0:1789175407.040727:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062784 00000100:00100000:0.0:1789175407.040801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:0.0:1789175407.040811:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5582:x1876086251062784:12345-192.168.201.18@tcp:501: 00000100:00100000:0.0:1789175407.041236:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5582:x1876086251062784:12345-192.168.201.18@tcp:501: Request processed in 425us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.041245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:2.0:1789175407.044357:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175407.044445:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251062912 00000100:00100000:3.0:1789175407.044456:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251062912 00000100:00100000:3.0:1789175407.044510:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:3.0:1789175407.044520:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5582:x1876086251062912:12345-192.168.201.18@tcp:503: 00000100:00100000:3.0:1789175407.044961:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5582:x1876086251062912:12345-192.168.201.18@tcp:503: Request processed in 441us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175407.044969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:3.0:1789175407.048800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175407.049139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063040 00000100:00100000:0.0:1789175407.049151:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063040 00000100:00100000:0.0:1789175407.049219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:0.0:1789175407.049231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5605:x1876086251063040:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1789175407.049589:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5605:x1876086251063040:12345-192.168.201.18@tcp:502: Request processed in 359us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.049598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:3.0:1789175407.053778:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175407.054084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063168 00000100:00100000:0.0:1789175407.054111:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063168 00000100:00100000:0.0:1789175407.054182:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:0.0:1789175407.054194:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5605:x1876086251063168:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1789175407.054493:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5605:x1876086251063168:12345-192.168.201.18@tcp:502: Request processed in 300us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.054502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:3.0:1789175407.059235:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175407.059400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063296 00000100:00100000:0.0:1789175407.059410:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063296 00000100:00100000:0.0:1789175407.059462:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1789175407.059471:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876086251063296:12345-192.168.201.18@tcp:38: 00010000:00080000:0.0:1789175407.059506:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1789175407.059563:0:5840:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c165f7 00000004:00100000:0.0:1789175407.059599:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789175407.059608:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789175407.075523:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789175407.085416:0:5840:0:(import.c:65:import_set_state_nolock()) ffff97e73be0a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175407.085515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251063296:12345-192.168.201.18@tcp:38: Request processed in 26042us (26327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175407.085527:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1789175407.521762:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274153600:0@lo:13: 00000100:00100000:3.0:1789175407.521853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175407.522098:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153600 00000100:00100000:2.0:1789175407.522108:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153600 00000100:00100000:2.0:1789175407.522207:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789175407.522218:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274153600:12345-0@lo:13: 00002000:00000024:2.0:1789175407.522267:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175407.522316:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274153600:12345-0@lo:13: Request processed in 99us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175407.522324:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789175407.522813:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175407.522851:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704000 x1876086274153600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175407.522873:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274153600:0@lo:13: 00000100:00100000:3.0:1789175408.033820:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274153856:0@lo:400: 00000100:00100000:3.0:1789175408.033931:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175408.034002:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789175408.034009:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274153728:0@lo:400: 00000100:00100000:3.0:1789175408.034041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175408.034062:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274154240:0@lo:400: 00000100:00100000:3.0:1789175408.034086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175408.034117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153728 00000100:00100000:3.0:1789175408.034138:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153728 00000100:00100000:3.0:1789175408.034188:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789175408.034198:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274153728:12345-0@lo:400: 00000100:00100000:3.0:1789175408.034245:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274153728:12345-0@lo:400: Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175408.034252:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789175408.034283:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154240 00000100:00100000:3.0:1789175408.034287:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154240 00000100:00100000:3.0:1789175408.034325:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175408.034332:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274154240:12345-0@lo:400: 00000100:00100000:3.0:1789175408.034389:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274154240:12345-0@lo:400: Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175408.034395:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789175408.034417:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175408.034737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274153728:0@lo:400: 00010000:00080000:0.0:1789175408.034754:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734265f80 x1876086274154240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175408.034764:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789175408.034777:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274154240:0@lo:400: 00000100:00100000:1.0:1789175408.034910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153856 00000100:00100000:1.0:1789175408.034915:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153856 00000100:00100000:1.0:1789175408.034953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789175408.034961:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274153856:12345-0@lo:400: 00000100:00100000:1.0:1789175408.035005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274153856:12345-0@lo:400: Request processed in 45us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175408.035010:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789175408.035080:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274153984:0@lo:400: 00000100:00100000:1.0:1789175408.035108:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175408.035144:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175408.035151:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274154112:0@lo:400: 00000100:00100000:1.0:1789175408.035173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175408.035210:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274153984 00000100:00100000:1.0:1789175408.035214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274153984 00000100:00100000:1.0:1789175408.035238:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154112 00000100:00100000:1.0:1789175408.035241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154112 00000100:00100000:1.0:1789175408.035258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789175408.035265:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274153984:12345-0@lo:400: 00000100:00100000:1.0:1789175408.035297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274153984:12345-0@lo:400: Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175408.035303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789175408.035313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789175408.035319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274154112:12345-0@lo:400: 00000100:00100000:1.0:1789175408.035365:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274154112:12345-0@lo:400: Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175408.035371:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789175408.035702:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789175408.035753:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734267100 x1876086274154112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175408.035765:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274154112:0@lo:400: 00010000:00080000:2.0:1789175408.035781:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734266a00 x1876086274153984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175408.035788:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274153984:0@lo:400: 00000100:00100000:3.0:1789175408.035884:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175408.035894:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274154368:0@lo:13: 00000100:00100000:3.0:1789175408.035927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789175408.036027:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734265500 x1876086274153856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175408.036045:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274153856:0@lo:400: 00000100:00100000:2.0:1789175408.036334:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154368 00000100:00100000:2.0:1789175408.036372:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154368 00000100:00100000:2.0:1789175408.036413:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789175408.036421:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274154368:12345-0@lo:13: 00002000:00000024:2.0:1789175408.036454:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175408.036514:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274154368:12345-0@lo:13: Request processed in 93us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175408.036519:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789175408.038695:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e7071d7100 x1876086274154368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175408.038734:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274154368:0@lo:13: 00000100:00100000:1.0:1789175408.096624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175408.097026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063552 00000100:00100000:3.0:1789175408.097039:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063552 00000100:00100000:3.0:1789175408.097135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1789175408.097146:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251063552:12345-192.168.201.18@tcp:41: 00000004:00000024:3.0:1789175408.097192:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789175408.097313:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251063552:12345-192.168.201.18@tcp:41: Request processed in 169us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175408.097321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00010000:00010000:1.0:1789175408.097852:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789175408.098084:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175408.098261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175408.098412:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063424 00000100:00100000:2.0:1789175408.098420:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063424 00000100:00100000:2.0:1789175408.098467:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1789175408.098476:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:0:x1876086251063424:12345-192.168.201.18@tcp:41: 00000004:00000024:2.0:1789175408.098501:0:8054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789175408.098562:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:0:x1876086251063424:12345-192.168.201.18@tcp:41: Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175408.098570:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175408.098992:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175408.099319:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063680 00000100:00100000:2.0:1789175408.099325:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063680 00000100:00100000:2.0:1789175408.099394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1789175408.099403:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251063680:12345-192.168.201.18@tcp:40: 00000100:00100000:2.0:1789175408.099482:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251063680:12345-192.168.201.18@tcp:40: Request processed in 81us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175408.099490:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175408.101412:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175408.101453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175408.101480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175408.101517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175408.101546:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064192 00000100:00100000:3.0:1789175408.101556:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064192 00000100:00100000:3.0:1789175408.101600:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:3.0:1789175408.101610:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251064192:12345-192.168.201.18@tcp:400: 00000100:00100000:3.0:1789175408.101691:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251064192:12345-192.168.201.18@tcp:400: Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175408.101698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:0.0:1789175408.105049:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063808 00000100:00100000:0.0:1789175408.105068:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063808 00000100:00100000:0.0:1789175408.105146:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251063936 00000100:00100000:0.0:1789175408.105152:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251063936 00000100:00100000:0.0:1789175408.105176:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1789175408.105186:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876086251063808:12345-192.168.201.18@tcp:8: 00010000:00080000:0.0:1789175408.105224:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1789175408.105263:0:6687:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c165fe 00002000:00100000:0.0:1789175408.105277:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b56eceb-e538-4909-8f73-c533ee4baa44/ffff97e73be0a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175408.105289:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175408.105758:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789175408.105797:0:6687:0:(import.c:65:import_set_state_nolock()) ffff97e73be0b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175408.106197:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251063808:12345-192.168.201.18@tcp:8: Request processed in 1008us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175408.106206:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1789175408.106235:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175408.106241:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876086251063936:12345-192.168.201.18@tcp:8: 00010000:00080000:0.0:1789175408.106263:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1789175408.106287:0:6687:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c16605 00002000:00100000:0.0:1789175408.106295:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5b56eceb-e538-4909-8f73-c533ee4baa44/ffff97e73be0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175408.106303:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175408.106594:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789175408.106630:0:6687:0:(import.c:65:import_set_state_nolock()) ffff97e73be08800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175408.106659:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251063936:12345-192.168.201.18@tcp:8: Request processed in 416us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175408.106665:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175408.106985:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064064 00000100:00100000:2.0:1789175408.106993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064064 00000100:00100000:2.0:1789175408.107043:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1789175408.107051:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251064064:12345-192.168.201.18@tcp:33: 00000004:00080000:3.0:1789175408.132463:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25331us 00000004:00200000:0.0:1789175408.144409:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789175408.144571:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5582:x1876086251064064:12345-192.168.201.18@tcp:33: Request processed in 37513us (43162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175408.144588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1789175408.404588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175408.404729:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064320 00000100:00100000:1.0:1789175408.404741:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064320 00000100:00100000:1.0:1789175408.404808:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:1.0:1789175408.404820:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5622:x1876086251064320:12345-192.168.201.18@tcp:101: 00010000:00010000:1.0:1789175408.404843:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175408.404934:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e74205ea00/0x1112cdeac4c1660c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2abf expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405043:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405058:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405081:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175408.405128:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789175408.405133:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175408.405153:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405181:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e74205ea00/0x1112cdeac4c1660c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2abf expref: 8 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405201:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2abf expref: 7 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175408.405224:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175408.405227:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175408.405230:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:1.0:1789175408.405306:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:5622:x1876086251064320:12345-192.168.201.18@tcp:101: Request processed in 488us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175408.405313:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:0.0:1789175409.122294:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175410.145696:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175410.263991:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175410.264279:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064448 00000100:00100000:0.0:1789175410.264294:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064448 00000100:00100000:0.0:1789175410.264451:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175410.264468:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:5674:x1876086251064448:12345-192.168.201.18@tcp:41: 00000004:00000024:0.0:1789175410.264533:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789175410.264764:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:5674:x1876086251064448:12345-192.168.201.18@tcp:41: Request processed in 301us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175410.264774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:2.0:1789175410.265174:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175410.269158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175410.269307:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064576 00000100:00100000:2.0:1789175410.269321:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064576 00000100:00100000:2.0:1789175410.269456:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175410.269469:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5674:x1876086251064576:12345-192.168.201.18@tcp:13: 00002000:00000024:2.0:1789175410.269518:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789175410.269698:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175410.269791:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5674:x1876086251064576:12345-192.168.201.18@tcp:13: Request processed in 323us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175410.269802:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1789175410.273171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175410.273332:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064704 00000100:00100000:2.0:1789175410.273374:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064704 00000100:00100000:2.0:1789175410.273458:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175410.273471:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5674:x1876086251064704:12345-192.168.201.18@tcp:13: 00002000:00000024:2.0:1789175410.273519:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175410.273601:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5b56eceb-e538-4909-8f73-c533ee4baa44+6:5674:x1876086251064704:12345-192.168.201.18@tcp:13: Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175410.273607:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00080000:3.0:1789175410.274023:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789175411.170058:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175412.201839:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789175412.225273:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000001:02000400:1.0:1789175412.532567:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789175412.641684:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274154496:0@lo:13: 00000100:00100000:3.0:1789175412.641767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175412.642018:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154496 00000100:00100000:2.0:1789175412.642034:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154496 00000100:00100000:2.0:1789175412.642191:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175412.642210:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274154496:12345-0@lo:13: 00002000:00000024:2.0:1789175412.642269:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175412.642407:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274154496:12345-0@lo:13: Request processed in 203us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175412.642416:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789175412.642614:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175412.642749:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704700 x1876086274154496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175412.642785:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274154496:0@lo:13: 00000001:00100000:1.0:1789175412.687289:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000100:00100000:3.0:1789175413.154474:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274154624:0@lo:13: 00000100:00100000:3.0:1789175413.154592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175413.154707:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154624 00000100:00100000:3.0:1789175413.154718:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154624 00000100:00100000:3.0:1789175413.154917:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175413.154918:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274154752:0@lo:400: 00000100:00100000:3.0:1789175413.154929:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274154624:12345-0@lo:13: 00000100:00100000:0.0:1789175413.154961:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789175413.154978:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175413.154999:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274155264:0@lo:400: 00000100:00100000:0.0:1789175413.155024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175413.155030:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274154624:12345-0@lo:13: Request processed in 103us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175413.155037:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175413.155053:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175413.155058:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274154880:0@lo:400: 00000100:00080000:3.0:1789175413.155063:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175413.155079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175413.155112:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154752 00000100:00100000:0.0:1789175413.155130:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154752 00000100:00100000:3.0:1789175413.155158:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274155008:0@lo:400: 00000100:00100000:0.0:1789175413.155161:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789175413.155167:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274154752:12345-0@lo:400: 00000100:00100000:3.0:1789175413.155186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175413.155199:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274154752:12345-0@lo:400: Request processed in 33us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175413.155204:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175413.155205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789175413.155208:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274155136:0@lo:400: 00000100:00100000:3.0:1789175413.155230:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175413.155236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155264 00000100:00100000:0.0:1789175413.155239:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155264 00000100:00100000:0.0:1789175413.155269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274154880 00010000:00080000:3.0:1789175413.155270:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e3cdc00 x1876086274154624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175413.155271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274154880 00000100:00100000:0.0:1789175413.155281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155008 00000100:00100000:0.0:1789175413.155283:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155008 00000100:00100000:3.0:1789175413.155295:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274154624:0@lo:13: 00000100:00100000:0.0:1789175413.155297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175413.155303:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274155264:12345-0@lo:400: 00000100:00100000:0.0:1789175413.155334:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274155264:12345-0@lo:400: Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175413.155358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175413.155370:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789175413.155375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274154880:12345-0@lo:400: 00000100:00100000:0.0:1789175413.155400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274154880:12345-0@lo:400: Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175413.155405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789175413.155414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789175413.155418:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274155008:12345-0@lo:400: 00000100:00100000:0.0:1789175413.155446:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274155008:12345-0@lo:400: Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175413.155451:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789175413.155456:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175413.155484:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274155008:0@lo:400: 00000100:00100000:0.0:1789175413.155509:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274154880:0@lo:400: 00000100:00100000:0.0:1789175413.155516:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274154752:0@lo:400: 00000100:00100000:0.0:1789175413.155525:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274155264:0@lo:400: 00000100:00100000:0.0:1789175413.155552:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155136 00000100:00100000:0.0:1789175413.155555:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155136 00000100:00100000:0.0:1789175413.155594:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789175413.155601:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274155136:12345-0@lo:400: 00000100:00100000:0.0:1789175413.155648:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274155136:12345-0@lo:400: Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175413.155654:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789175413.155677:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704380 x1876086274155136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175413.155687:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274155136:0@lo:400: 00010000:00010000:0.0:1789175413.225538:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789175413.281815:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000100:00100000:1.0:1789175413.384243:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175413.385518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175413.385558:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175413.385608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175413.385653:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064832 00000100:00100000:1.0:1789175413.385668:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064832 00000100:00100000:1.0:1789175413.385730:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:1.0:1789175413.385742:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251064832:12345-192.168.201.18@tcp:400: 00000100:00100000:1.0:1789175413.386175:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251064832:12345-192.168.201.18@tcp:400: Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175413.386187:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:3.0:1789175413.387217:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065216 00000100:00100000:3.0:1789175413.387230:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065216 00000100:00100000:3.0:1789175413.387312:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065088 00000100:00100000:3.0:1789175413.387316:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065088 00000100:00100000:3.0:1789175413.387362:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175413.387374:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251065216:12345-192.168.201.18@tcp:400: 00000100:00100000:3.0:1789175413.387470:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251065216:12345-192.168.201.18@tcp:400: Request processed in 99us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175413.387478:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175413.387494:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175413.387501:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251065088:12345-192.168.201.18@tcp:400: 00000100:00100000:3.0:1789175413.387527:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251065088:12345-192.168.201.18@tcp:400: Request processed in 27us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175413.387534:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:2.0:1789175413.387957:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789175413.387969:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175413.392404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251064960 00000100:00100000:0.0:1789175413.392422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251064960 00000100:00100000:0.0:1789175413.392505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1789175413.392518:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251064960:12345-192.168.201.18@tcp:400: 00000100:00080000:2.0:1789175413.392543:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175413.392640:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251064960:12345-192.168.201.18@tcp:400: Request processed in 123us (8407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175413.392648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00010000:00010000:0.0:1789175414.241625:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175415.266793:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175416.291398:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789175416.396220:0:8443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce8199e10 20000000:00000080:2.0:1789175416.396242:0:8443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e73be33800 uarg=0000000000000000 20000000:01000000:2.0:1789175416.396372:0:8443:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789175416.396374:0:8443:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789175416.396376:0:8443:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789175416.396381:0:8443:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789175416.396386:0:8443:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789175416.396401:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789175416.396403:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789175416.396767:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789175416.396770:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789175416.402842:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789175416.403672:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789175416.403730:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789175416.403764:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789175416.403782:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789175416.403786:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789175416.404703:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789175416.405120:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789175416.405181:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789175416.405218:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789175416.405233:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789175416.405235:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789175416.406614:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789175416.407047:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789175416.407086:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789175416.407127:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789175416.407141:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789175416.407144:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789175416.407980:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789175416.408326:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789175416.408623:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789175416.408660:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1789175416.408679:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789175416.408704:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408727:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408735:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408741:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408748:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408754:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408761:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408767:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408778:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408785:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408801:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408850:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.408868:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 9 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.408885:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155392:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175416.409129:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.409139:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 9 pid: 5832 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.409148:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155520:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175416.409182:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.409190:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 18 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.409199:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155648:0@lo:104: 00000100:00100000:3.0:1789175416.409242:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175416.409367:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.409384:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 18 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.409392:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155776:0@lo:104: 00000100:00100000:3.0:1789175416.409417:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175416.410018:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.410027:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 18 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.410036:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155904:0@lo:104: 00010000:00010000:3.0:1789175416.410063:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.410071:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 18 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.410079:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156032:0@lo:104: 00010000:00010000:3.0:1789175416.410103:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.410111:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.410118:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156160:0@lo:104: 00010000:00010000:3.0:1789175416.410141:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.410161:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.410169:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156288:0@lo:104: 00010000:00010000:3.0:1789175416.410191:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.410198:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 18 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.410205:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156416:0@lo:104: 00000100:00100000:3.0:1789175416.410221:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175416.412860:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789175416.412909:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175416.412934:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175416.412944:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175416.412955:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175416.412964:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175416.412975:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155648 00000100:00100000:2.0:1789175416.412985:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155648 00000100:00100000:2.0:1789175416.413052:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155776 00000100:00100000:2.0:1789175416.413056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155776 00000100:00100000:2.0:1789175416.413068:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274155904 00000100:00100000:2.0:1789175416.413071:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274155904 00000100:00100000:2.0:1789175416.413079:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156032 00000100:00100000:2.0:1789175416.413081:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156032 00000100:00100000:2.0:1789175416.413090:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156160 00000100:00100000:2.0:1789175416.413092:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156160 00000100:00100000:2.0:1789175416.413101:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156288 00000100:00100000:2.0:1789175416.413103:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156288 00000100:00100000:2.0:1789175416.413111:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156416 00000100:00100000:2.0:1789175416.413113:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156416 00000100:00100000:2.0:1789175416.413125:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175416.413133:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:8443:x1876086274155648:12345-0@lo:104: 00010000:00010000:2.0:1789175416.413155:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.413319:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175416.413327:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+9:8443:x1876086274155648:12345-0@lo:104: Request processed in 194us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.413334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175416.413374:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789175416.413381:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73412b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+8:8443:x1876086274155776:12345-0@lo:104: 00010000:00010000:2.0:1789175416.413389:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.413426:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789175416.413432:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73412b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+8:8443:x1876086274155776:12345-0@lo:104: Request processed in 53us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.413439:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175416.413892:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175416.413924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175416.413943:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065344 00000100:00100000:3.0:1789175416.413948:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065344 00010000:00010000:3.0:1789175416.413975:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 10 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.413999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065472 00000100:00100000:3.0:1789175416.414002:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065472 00010000:00010000:3.0:1789175416.414015:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 11 pid: 5832 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.414029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175416.414036:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2354:x1876086251065344:12345-192.168.201.18@tcp:103: 00010000:00010000:3.0:1789175416.414049:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.414055:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 11 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.414077:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 11 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.414101:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.414146:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2354:x1876086251065344:12345-192.168.201.18@tcp:103: Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.414153:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175416.414167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1789175416.414172:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251065472:12345-192.168.201.18@tcp:103: 00010000:00010000:3.0:1789175416.414179:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.414183:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 10 pid: 5832 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.414193:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 10 pid: 5832 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.414202:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.414216:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251065472:12345-192.168.201.18@tcp:103: Request processed in 44us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.414221:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1789175416.414471:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789175416.414549:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:8443:x1876086274155904:12345-0@lo:104: 00010000:00010000:2.0:1789175416.414559:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414609:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789175416.414614:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+7:8443:x1876086274155904:12345-0@lo:104: Request processed in 69us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.414619:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789175416.414632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789175416.414638:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:8443:x1876086274156032:12345-0@lo:104: 00010000:00010000:2.0:1789175416.414646:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414675:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789175416.414680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+6:8443:x1876086274156032:12345-0@lo:104: Request processed in 42us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.414685:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789175416.414753:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789175416.414760:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:8443:x1876086274156160:12345-0@lo:104: 00010000:00010000:2.0:1789175416.414767:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414795:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789175416.414799:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:8443:x1876086274156160:12345-0@lo:104: Request processed in 41us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.414804:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789175416.414823:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789175416.414829:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:8443:x1876086274156288:12345-0@lo:104: 00010000:00010000:2.0:1789175416.414836:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414863:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789175416.414867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:8443:x1876086274156288:12345-0@lo:104: Request processed in 39us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.414872:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789175416.414882:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789175416.414887:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:8443:x1876086274156416:12345-0@lo:104: 00010000:00010000:2.0:1789175416.414894:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414915:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789175416.414919:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:8443:x1876086274156416:12345-0@lo:104: Request processed in 33us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175416.414924:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789175416.414939:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789175416.414945:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414953:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205ec00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.414957:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.414966:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.414983:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.414988:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415023:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415029:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415047:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415054:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205ec00/0x1112cdeac4c165c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415069:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789175416.415072:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415078:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.415080:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415086:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.415092:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.415096:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415116:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415121:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415137:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415142:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1400/0x1112cdeac4c1659c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c165a3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415152:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789175416.415155:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415161:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.415164:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415171:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.415176:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.415182:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415194:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415200:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415205:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415221:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e700030e00/0x1112cdeac4c16580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16587 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415232:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789175416.415234:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415240:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205f800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.415243:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415250:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.415256:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.415261:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415274:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415280:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415286:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415292:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205f800/0x1112cdeac4c16572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16579 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415301:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789175416.415309:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415315:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e74205ee00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.415317:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415324:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.415330:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.415334:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415372:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415379:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415383:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415389:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e74205ee00/0x1112cdeac4c16564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1656b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415397:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789175416.415400:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415405:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701526000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175416.415408:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415424:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175416.415430:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175416.415435:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789175416.415448:0:6702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415454:0:6702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175416.415458:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175416.415464:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701526000/0x1112cdeac4c1653a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16541 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175416.415818:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1789175416.415843:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175416.415849:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175416.415857:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175416.415860:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175416.415867:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175416.415874:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175416.415879:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175416.415896:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175416.415901:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175416.415906:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175416.415911:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16517 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175416.415925:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175416.415926:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175416.415928:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175416.415934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175416.415939:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175416.415959:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274156544:0@lo:103: 00000100:00100000:0.0:1789175416.416023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175416.416065:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274157056:0@lo:103: 00000100:00100000:0.0:1789175416.416085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175416.416107:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175416.416113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274156928:0@lo:103: 00000100:00100000:0.0:1789175416.416133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175416.416164:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274156672:0@lo:103: 00000100:00100000:0.0:1789175416.416185:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175416.416195:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274157184:0@lo:103: 00000100:00100000:0.0:1789175416.416216:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175416.416226:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175416.416231:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274157312:0@lo:103: 00000100:00100000:0.0:1789175416.416248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175416.416440:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274156800:0@lo:103: 00000100:00100000:3.0:1789175416.416467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175416.416569:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156544 00000100:00100000:3.0:1789175416.416586:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156544 00010000:00010000:3.0:1789175416.416619:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 19 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416649:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157056 00000100:00100000:3.0:1789175416.416653:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157056 00010000:00010000:3.0:1789175416.416663:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 20 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416671:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156928 00000100:00100000:3.0:1789175416.416673:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156928 00010000:00010000:3.0:1789175416.416682:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 21 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416691:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156672 00000100:00100000:3.0:1789175416.416693:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156672 00010000:00010000:3.0:1789175416.416777:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 22 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416789:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157184 00000100:00100000:3.0:1789175416.416793:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157184 00010000:00010000:3.0:1789175416.416806:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 23 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416815:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157312 00000100:00100000:3.0:1789175416.416818:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157312 00010000:00010000:3.0:1789175416.416828:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 24 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416838:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274156800 00000100:00100000:3.0:1789175416.416840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274156800 00010000:00010000:3.0:1789175416.416849:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 25 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175416.416861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175416.416874:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+25:3305:x1876086274156544:12345-0@lo:103: 00010000:00010000:3.0:1789175416.416888:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.416893:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 25 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.416906:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 25 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.416924:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175416.417034:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175416.417037:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175416.417039:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175416.417124:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+25:3305:x1876086274156544:12345-0@lo:103: Request processed in 250us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417132:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175416.417151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175416.417157:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+24:3305:x1876086274157056:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417166:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417170:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 24 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417178:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 24 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417187:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417208:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+24:3305:x1876086274157056:12345-0@lo:103: Request processed in 52us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175416.417226:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175416.417231:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+23:3305:x1876086274156928:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417238:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417249:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 23 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417257:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 23 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417267:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+23:3305:x1876086274156928:12345-0@lo:103: Request processed in 58us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417296:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175416.417315:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789175416.417321:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+22:3306:x1876086274156672:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417328:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417333:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 22 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417372:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 22 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417382:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417416:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+22:3306:x1876086274156672:12345-0@lo:103: Request processed in 95us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417422:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789175416.417441:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789175416.417449:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+21:3306:x1876086274157184:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417456:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417461:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 21 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417568:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 21 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417589:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417615:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+21:3306:x1876086274157184:12345-0@lo:103: Request processed in 167us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417621:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789175416.417655:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789175416.417663:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274157312:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417671:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417676:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 20 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417684:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 20 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417694:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417797:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274157312:12345-0@lo:103: Request processed in 134us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789175416.417817:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789175416.417823:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274156800:12345-0@lo:103: 00010000:00010000:3.0:1789175416.417832:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175416.417836:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 19 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417846:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 19 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417864:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417873:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417891:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417899:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417907:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417913:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417920:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175416.417925:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417933:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417942:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175416.417952:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175416.417981:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274156800:12345-0@lo:103: Request processed in 158us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175416.417994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789175416.418037:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274156800:0@lo:103: 00010000:00010000:1.0:1789175416.418229:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031600/0x1112cdeac4c165cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c165c6 expref: 18 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418242:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155648:0@lo:104: 00000100:00100000:2.0:1789175416.418410:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274157312:0@lo:103: 00000100:00100000:2.0:1789175416.418422:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274156672:0@lo:103: 00000100:00100000:2.0:1789175416.418431:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274157184:0@lo:103: 00000100:00100000:0.0:1789175416.418615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274156544:0@lo:103: 00000100:00100000:0.0:1789175416.418627:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274157056:0@lo:103: 00000100:00100000:0.0:1789175416.418644:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274156928:0@lo:103: 00010000:00010000:1.0:1789175416.418851:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700030800/0x1112cdeac4c165a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1659c expref: 17 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418865:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155776:0@lo:104: 00010000:00010000:1.0:1789175416.418875:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16580 expref: 16 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418883:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155904:0@lo:104: 00010000:00010000:1.0:1789175416.418893:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205fe00/0x1112cdeac4c16579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16572 expref: 15 pid: 5833 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418901:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156032:0@lo:104: 00010000:00010000:1.0:1789175416.418910:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031a00/0x1112cdeac4c1656b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16564 expref: 14 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418925:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156160:0@lo:104: 00010000:00010000:1.0:1789175416.418936:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205f200/0x1112cdeac4c16541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1653a expref: 13 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418944:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156288:0@lo:104: 00010000:00010000:1.0:1789175416.418952:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205f000/0x1112cdeac4c16517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16510 expref: 12 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418959:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274156416:0@lo:104: 00010000:00010000:1.0:1789175416.418974:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1e00/0x1112cdeac4c165e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a64 expref: 9 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.418983:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155392:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175416.418993:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c165db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a5d expref: 8 pid: 5832 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175416.419000:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876086274155520:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175416.419029:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175416.419039:0:8443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175416.419046:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175416.419052:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9600/0x1112cdeac4c1661a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.313749:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789175417.569642:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789175417.569651:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7264f7000 from 39 10000000:01000000:0.0:1789175417.569656:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789175417.569705:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.569718:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.569750:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175417.569776:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157440:0@lo:101: 00000100:00100000:0.0:1789175417.569849:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.569979:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157440 00000100:00100000:3.0:1789175417.569986:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157440 00000100:00100000:3.0:1789175417.570039:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789175417.570047:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+12:5835:x1876086274157440:12345-0@lo:101: 00010000:00010000:3.0:1789175417.570060:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175417.570072:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9400/0x1112cdeac4c16628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16621 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.570093:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9400/0x1112cdeac4c16628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16621 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.570103:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9400/0x1112cdeac4c16628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16621 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.570112:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9400, rc 0) 00000100:00100000:3.0:1789175417.570145:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274157440:12345-0@lo:101: Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175417.570151:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789175417.570216:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070f3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.570237:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157440:0@lo:101: 00010000:00010000:0.0:1789175417.570250:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.570268:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175417.570318:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157568:0@lo:501: 00000100:00100000:0.0:1789175417.570371:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.570444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157568 00000100:00100000:1.0:1789175417.570449:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157568 00000100:00100000:1.0:1789175417.570479:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789175417.570485:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274157568:12345-0@lo:501: 00000100:00100000:1.0:1789175417.570745:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274157568:12345-0@lo:501: Request processed in 260us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.570752:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789175417.572977:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070f3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.573022:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157568:0@lo:501: 00000100:00100000:0.0:1789175417.573080:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157696:0@lo:503: 00000100:00100000:0.0:1789175417.573162:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.573321:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070f3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.573691:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157696 00000100:00100000:1.0:1789175417.573698:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157696 00000100:00100000:0.0:1789175417.573879:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789175417.573888:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274157696:12345-0@lo:503: 00000100:00100000:0.0:1789175417.574129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274157696:12345-0@lo:503: Request processed in 241us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.574137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789175417.574230:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274157696:0@lo:503: 00000100:00100000:1.0:1789175417.575147:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8460:1876086274157824:0@lo:502: 00000100:00100000:1.0:1789175417.575211:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.575426:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175417.575672:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157824 00000100:00100000:3.0:1789175417.575679:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157824 00000100:00100000:3.0:1789175417.575712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789175417.575719:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:8460:x1876086274157824:12345-0@lo:502: 00000100:00100000:3.0:1789175417.575950:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:8460:x1876086274157824:12345-0@lo:502: Request processed in 230us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175417.575959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789175417.576215:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8460:1876086274157824:0@lo:502: 00000100:00100000:1.0:1789175417.576264:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8460:1876086274157952:0@lo:502: 00000100:00100000:1.0:1789175417.576298:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.576317:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175417.576585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274157952 00000100:00100000:3.0:1789175417.576590:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274157952 00000100:00100000:3.0:1789175417.576619:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789175417.576627:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:8460:x1876086274157952:12345-0@lo:502: 00000100:00100000:3.0:1789175417.576786:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:8460:x1876086274157952:12345-0@lo:502: Request processed in 159us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175417.576793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789175417.576918:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8460:1876086274157952:0@lo:502: 00000040:00080000:1.0:1789175417.576939:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789175417.577508:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789175417.577536:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789175417.577546:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.577568:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175417.577578:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789175417.577581:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789175417.577584:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789175417.577622:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.577630:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.577639:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175417.577654:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158080:0@lo:101: 00000100:00100000:3.0:1789175417.577691:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.577719:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97180 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.577889:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158080 00000100:00100000:0.0:1789175417.577894:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158080 00000100:00100000:0.0:1789175417.577923:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789175417.577931:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+13:5835:x1876086274158080:12345-0@lo:101: 00010000:00010000:0.0:1789175417.577941:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175417.577954:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031a00/0x1112cdeac4c16636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1662f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.577975:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031a00/0x1112cdeac4c16636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1662f expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.577986:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031a00/0x1112cdeac4c16636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1662f expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.577994:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031a00, rc 0) 00000100:00100000:0.0:1789175417.578041:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158080:12345-0@lo:101: Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.578046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789175417.578175:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158080:0@lo:101: 00010000:00010000:3.0:1789175417.578187:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.578260:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175417.578307:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158208:0@lo:501: 00000100:00100000:3.0:1789175417.578375:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.578491:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158208 00000100:00100000:0.0:1789175417.578495:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158208 00000100:00100000:0.0:1789175417.578524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789175417.578531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158208:12345-0@lo:501: 00000100:00100000:0.0:1789175417.578917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158208:12345-0@lo:501: Request processed in 385us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.578924:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789175417.579045:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175417.579060:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158208:0@lo:501: 00000100:00100000:3.0:1789175417.579087:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158336:0@lo:503: 00000100:00100000:3.0:1789175417.579122:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.579142:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97180 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.579207:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158336 00000100:00100000:2.0:1789175417.579212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158336 00000100:00100000:2.0:1789175417.579245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789175417.579252:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158336:12345-0@lo:503: 00000100:00100000:2.0:1789175417.579470:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158336:12345-0@lo:503: Request processed in 217us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.579477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789175417.579822:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158336:0@lo:503: 00000100:00100000:3.0:1789175417.580256:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8461:1876086274158464:0@lo:502: 00000100:00100000:3.0:1789175417.580296:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.580321:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97840 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.580578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158464 00000100:00100000:2.0:1789175417.580584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158464 00000100:00100000:2.0:1789175417.580717:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789175417.580726:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8461:x1876086274158464:12345-0@lo:502: 00000100:00100000:2.0:1789175417.580905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8461:x1876086274158464:12345-0@lo:502: Request processed in 179us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.580912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789175417.581055:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8461:1876086274158464:0@lo:502: 00000020:01000000:3.0:1789175417.581077:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175417.581086:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175417.581089:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789175417.581094:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789175417.581118:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8461:1876086274158592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.581149:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.586054:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.587612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158592 00000100:00100000:0.0:1789175417.587626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158592 00000100:00100000:0.0:1789175417.587691:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789175417.587702:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8461:x1876086274158592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.588022:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:8461:x1876086274158592:12345-0@lo:502:llog_process_th.0 Request processed in 320us (6870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.588030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789175417.588427:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8461:1876086274158592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175417.588463:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175417.588471:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175417.588473:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789175417.588478:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789175417.588758:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789175417.588779:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789175417.588841:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.588853:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175417.588863:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789175417.588866:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e73c3b2800 from 39 10000000:01000000:0.0:1789175417.588868:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789175417.588900:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.588907:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.588915:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175417.588935:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.588974:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.589100:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70b1fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.594620:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158720 00000100:00100000:2.0:1789175417.594637:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158720 00000100:00100000:2.0:1789175417.594694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789175417.594704:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:5835:x1876086274158720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175417.594720:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175417.594738:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a1400/0x1112cdeac4c16644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1663d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.594768:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1400/0x1112cdeac4c16644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1663d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.594779:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a1400/0x1112cdeac4c16644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1663d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.594801:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1400, rc 0) 00000100:00100000:2.0:1789175417.594889:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274158720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (5914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.594896:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789175417.595269:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175417.595288:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.595306:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175417.595425:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.595458:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.595490:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70b1fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.596113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158848 00000100:00100000:2.0:1789175417.596119:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158848 00000100:00100000:2.0:1789175417.596143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789175417.596150:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274158848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175417.596645:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274158848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 493us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.596654:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789175417.596796:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.596834:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.596877:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.596911:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70b1fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.597042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274158976 00000100:00100000:2.0:1789175417.597046:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274158976 00000100:00100000:2.0:1789175417.597066:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789175417.597073:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274158976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175417.597384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274158976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.597392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789175417.602733:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274158976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175417.606851:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8462:1876086274159104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.606951:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.606998:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.607054:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159104 00000100:00100000:1.0:1789175417.607062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159104 00000100:00100000:1.0:1789175417.607116:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789175417.607126:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8462:x1876086274159104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.607588:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8462:x1876086274159104:12345-0@lo:502:llog_process_th.0 Request processed in 462us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.607604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789175417.608426:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8462:1876086274159104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.608728:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8462:1876086274159232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.609772:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.609834:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.611116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159232 00000100:00100000:0.0:1789175417.611129:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159232 00000100:00100000:0.0:1789175417.611202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789175417.611212:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8462:x1876086274159232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.612779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:8462:x1876086274159232:12345-0@lo:502:llog_process_th.0 Request processed in 1562us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.612793:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789175417.612997:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8462:1876086274159232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789175417.613034:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789175417.613292:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789175417.613315:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789175417.613325:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.613335:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175417.613391:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789175417.613394:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789175417.613396:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789175417.616005:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.616023:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.616037:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175417.616067:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.616139:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.616181:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70b1fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.617171:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159360 00000100:00100000:1.0:1789175417.617181:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159360 00000100:00100000:1.0:1789175417.617230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789175417.617239:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+15:5835:x1876086274159360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.617253:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175417.617269:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c16652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1664b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.617294:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c16652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1664b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.617304:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c16652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1664b expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.617313:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ac00, rc 0) 00000100:00100000:1.0:1789175417.617390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274159360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.617397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789175417.617459:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.617478:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.617488:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175417.617563:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.617625:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.617649:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.617663:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159488 00000100:00100000:1.0:1789175417.617666:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159488 00000100:00100000:1.0:1789175417.617687:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789175417.617693:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274159488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.617936:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274159488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.617943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789175417.617968:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.617992:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.618026:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.618038:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.618049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159616 00000100:00100000:1.0:1789175417.618052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159616 00000100:00100000:1.0:1789175417.618067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789175417.618072:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274159616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.618217:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274159616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.618224:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789175417.618258:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274159616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.618467:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8463:1876086274159744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.618499:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.618518:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159744 00000100:00100000:1.0:1789175417.618527:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159744 00000100:00100000:1.0:1789175417.618550:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789175417.618568:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8463:x1876086274159744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.618695:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8463:x1876086274159744:12345-0@lo:502:llog_process_th.0 Request processed in 128us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.618701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789175417.618729:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.618740:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8463:1876086274159744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789175417.618761:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789175417.618787:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175417.618790:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789175417.618797:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789175417.618816:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8463:1876086274159872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.618846:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.618865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274159872 00000100:00100000:1.0:1789175417.618869:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274159872 00000100:00100000:1.0:1789175417.618891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789175417.618897:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8463:x1876086274159872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.619001:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:8463:x1876086274159872:12345-0@lo:502:llog_process_th.0 Request processed in 103us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.619007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789175417.619033:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.619044:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8463:1876086274159872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789175417.619060:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175417.619064:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175417.619066:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789175417.619069:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789175417.619125:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789175417.619148:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789175417.619157:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619167:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175417.619177:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789175417.619179:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7201da000 from 39 10000000:01000000:1.0:1789175417.619182:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789175417.619204:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619211:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619220:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175417.619233:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.619256:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.619269:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.619280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160000 00000100:00100000:1.0:1789175417.619283:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160000 00000100:00100000:1.0:1789175417.619303:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789175417.619308:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274160000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.619315:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175417.619326:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b800/0x1112cdeac4c16660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16659 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619379:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b800/0x1112cdeac4c16660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16659 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619389:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b800/0x1112cdeac4c16660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16659 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619397:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b800, rc 0) 00000100:00100000:1.0:1789175417.619428:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.619434:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789175417.619462:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.619472:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.619481:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175417.619519:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.619540:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.619562:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.619573:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160128 00000100:00100000:1.0:1789175417.619576:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160128 00000100:00100000:1.0:1789175417.619594:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789175417.619600:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.619772:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.619789:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789175417.619820:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.619843:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.619875:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.619887:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.619898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160256 00000100:00100000:1.0:1789175417.619901:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160256 00000100:00100000:1.0:1789175417.619921:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789175417.619926:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.620048:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.620055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789175417.620088:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.631609:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8464:1876086274160384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.631725:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.631777:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.639419:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160384 00000100:00100000:1.0:1789175417.639436:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160384 00000100:00100000:1.0:1789175417.639519:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789175417.639530:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8464:x1876086274160384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.639888:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8464:x1876086274160384:12345-0@lo:502:llog_process_th.0 Request processed in 359us (8162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.639897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789175417.641908:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8464:1876086274160384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.641995:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8464:1876086274160512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.642061:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175417.642110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160512 00000100:00100000:0.0:1789175417.642110:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7077aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789175417.642116:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160512 00000100:00100000:2.0:1789175417.642161:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789175417.642170:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8464:x1876086274160512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175417.642565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8464:x1876086274160512:12345-0@lo:502:llog_process_th.0 Request processed in 385us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175417.642573:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789175417.642622:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8464:1876086274160512:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789175417.642642:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789175417.642877:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789175417.642907:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789175417.642919:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.642929:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175417.642946:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789175417.642950:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789175417.642953:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789175417.642979:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.642987:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175417.642995:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175417.643009:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789175417.643039:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175417.643067:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.643401:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160640 00000100:00100000:1.0:1789175417.643407:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160640 00000100:00100000:1.0:1789175417.643433:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789175417.643441:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274160640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.643468:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175417.643490:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a600/0x1112cdeac4c1666e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16667 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.643512:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a600/0x1112cdeac4c1666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16667 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.643521:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a600/0x1112cdeac4c1666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16667 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.643530:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a600, rc 0) 00000100:00100000:1.0:1789175417.643584:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274160640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.643590:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789175417.643853:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175417.643867:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175417.643876:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175417.643929:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175417.643958:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.643986:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.644033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160768 00000100:00100000:1.0:1789175417.644037:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160768 00000100:00100000:1.0:1789175417.644068:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789175417.644073:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274160768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.644711:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274160768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 635us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.644726:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789175417.645631:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175417.645688:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175417.645736:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.645767:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.645893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274160896 00000100:00100000:1.0:1789175417.645899:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274160896 00000100:00100000:1.0:1789175417.645935:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789175417.645943:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274160896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.646167:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274160896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.646175:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789175417.646274:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274160896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175417.648134:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8465:1876086274161024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.648209:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.648249:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97180 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.648302:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161024 00000100:00100000:0.0:1789175417.648309:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161024 00000100:00100000:0.0:1789175417.648375:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789175417.648385:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8465:x1876086274161024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175417.648970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8465:x1876086274161024:12345-0@lo:502:llog_process_th.0 Request processed in 586us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.648979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789175417.649069:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8465:1876086274161024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175417.649101:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175417.649110:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175417.649113:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789175417.649119:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789175417.649144:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8465:1876086274161152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175417.649178:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175417.649205:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97180 going to sleep for 11 seconds 00000100:00100000:1.0:1789175417.649253:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161152 00000100:00100000:1.0:1789175417.649258:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161152 00000100:00100000:1.0:1789175417.649290:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789175417.649297:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8465:x1876086274161152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175417.649471:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8465:x1876086274161152:12345-0@lo:502:llog_process_th.0 Request processed in 175us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175417.649495:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789175417.653452:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8465:1876086274161152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175417.653514:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175417.653525:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175417.653528:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789175417.653533:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789175417.653806:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789175417.653836:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789175417.653847:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.653858:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175417.653870:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789175417.653872:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e7070799c0 from 1 10000000:01000000:1.0:1789175417.653875:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789175417.653911:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.653919:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.653928:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175417.653947:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274161280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.654006:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.654050:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.654125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161280 00000100:00100000:0.0:1789175417.654132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161280 00000100:00100000:0.0:1789175417.654170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789175417.654179:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274161280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175417.654190:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175417.654203:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700030e00/0x1112cdeac4c1667c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16675 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.654226:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700030e00/0x1112cdeac4c1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16675 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.654235:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700030e00/0x1112cdeac4c1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16675 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175417.654244:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700030e00, rc 0) 00000100:00100000:0.0:1789175417.654295:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274161280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175417.654311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789175417.654419:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274161280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175417.654431:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.654453:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175417.654512:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274161408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175417.654538:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175417.654573:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175417.654718:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161408 00000100:00100000:0.0:1789175417.654722:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161408 00000100:00100000:0.0:1789175417.654740:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789175417.654746:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274161408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175417.654977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274161408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (438us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175417.654985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789175417.655047:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274161408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789175417.655067:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789175417.655072:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175417.655080:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175417.766745:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175417.766772:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274161536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175417.766844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175417.767026:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161536 00000100:00100000:0.0:1789175417.767034:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161536 00000100:00100000:0.0:1789175417.767104:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789175417.767115:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274161536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175417.767152:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175417.767203:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274161536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (359us total) trans 0 rc 0/0 00010000:00080000:3.0:1789175417.767382:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726706d80 x1876086274161536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175417.767420:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274161536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789175417.767563:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175417.769072:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175418.274253:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274161792:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175418.274413:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274162304:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175418.274459:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175418.274463:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274161920:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175418.274501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161792 00000100:00100000:3.0:1789175418.274508:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161792 00000100:00100000:3.0:1789175418.274568:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161920 00000100:00100000:3.0:1789175418.274571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161920 00000100:00100000:3.0:1789175418.274603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789175418.274612:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274161792:12345-0@lo:400:kworker.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175418.274671:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789175418.274683:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789175418.274687:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274161920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274704:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274161920:12345-0@lo:400:kworker.0 Request processed in 18us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175418.274709:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789175418.274723:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162304 00000100:00100000:3.0:1789175418.274725:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162304 00000100:00100000:3.0:1789175418.274744:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175418.274760:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274162304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274781:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274162304:12345-0@lo:400:kworker.0 Request processed in 22us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175418.274785:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175418.274803:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274162048:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175418.274836:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789175418.274839:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274161664:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.274856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175418.274867:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274162176:0@lo:400:kworker.0 00000100:00100000:1.0:1789175418.274970:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162048 00000100:00100000:1.0:1789175418.274974:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162048 00000100:00100000:1.0:1789175418.274994:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789175418.274998:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274162048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175418.275023:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274162048:12345-0@lo:400:kworker.0 Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175418.275026:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789175418.275050:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175418.275054:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175418.275074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274161920:0@lo:400:kworker.0 00000100:00100000:1.0:1789175418.275080:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274161792:0@lo:400:kworker.0 00010000:00080000:1.0:1789175418.275098:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26ea00 x1876086274162304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175418.275105:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274162304:0@lo:400:kworker.0 00000100:00100000:0.0:1789175418.275277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274161664 00000100:00100000:0.0:1789175418.275280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274161664 00000100:00100000:0.0:1789175418.275315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789175418.275321:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274161664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175418.275371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274161664:12345-0@lo:400:kworker.0 Request processed in 49us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175418.275377:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789175418.275602:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789175418.275629:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26ed80 x1876086274162048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175418.275639:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274162048:0@lo:400:kworker.0 00000100:00100000:3.0:1789175418.275653:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274161664:0@lo:400:kworker.0 00000100:00100000:0.0:1789175418.276056:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162176 00000100:00100000:0.0:1789175418.276060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162176 00000100:00100000:0.0:1789175418.276088:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789175418.276098:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175418.276130:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274162176:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175418.276137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789175418.276152:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175418.276173:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274162176:0@lo:400:kworker.0 00000100:00100000:2.0:1789175418.276491:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175418.276502:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274162432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175418.276554:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175418.276588:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162432 00000100:00100000:2.0:1789175418.276591:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162432 00000100:00100000:2.0:1789175418.276622:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789175418.276629:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274162432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175418.276661:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175418.276699:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274162432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175418.276705:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789175418.276740:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733d07480 x1876086274162432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175418.276754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274162432:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789175418.337840:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175418.500399:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175418.500440:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175418.500468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175418.500493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175418.500521:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065856 00000100:00100000:1.0:1789175418.500532:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065856 00000100:00100000:0.0:1789175418.500535:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065728 00000100:00100000:0.0:1789175418.500551:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065728 00000100:00100000:0.0:1789175418.500619:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1789175418.500628:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251065728:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1789175418.500700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251065728:12345-192.168.201.18@tcp:400: Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175418.500707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1789175418.500764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065600 00000100:00100000:2.0:1789175418.500769:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065600 00000100:00100000:2.0:1789175418.500802:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:2.0:1789175418.500809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:2354:x1876086251065600:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1789175418.500837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:2354:x1876086251065600:12345-192.168.201.18@tcp:400: Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175418.500842:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:3.0:1789175418.501317:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251065984 00000100:00100000:3.0:1789175418.501321:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251065984 00000100:00100000:1.0:1789175418.504740:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1789175418.504757:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251065856:12345-192.168.201.18@tcp:400: 00000100:00100000:1.0:1789175418.504838:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251065856:12345-192.168.201.18@tcp:400: Request processed in 89us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175418.504844:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00080000:0.0:1789175418.505310:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789175418.505318:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789175418.505323:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175418.505818:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1789175418.505829:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251065984:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1789175418.505875:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251065984:12345-192.168.201.18@tcp:400: Request processed in 49us (5381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175418.505879:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:0.0:1789175419.362843:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175420.387569:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175421.058612:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175421.058928:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066112 00000100:00100000:0.0:1789175421.058939:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066112 00000100:00100000:0.0:1789175421.059001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:0.0:1789175421.059011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:5596:x1876086251066112:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1789175421.059028:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175421.059049:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031800/0x1112cdeac4c16683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ac6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.059092:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031800/0x1112cdeac4c16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ac6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.059120:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031800/0x1112cdeac4c16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ac6 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.059129:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031800, rc 0) 00000100:00100000:0.0:1789175421.059198:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066112:12345-192.168.201.18@tcp:101: Request processed in 188us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175421.059205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:0.0:1789175421.065885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175421.065988:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066240 00000100:00100000:2.0:1789175421.066000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066240 00000100:00100000:2.0:1789175421.066060:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:2.0:1789175421.066070:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066240:12345-192.168.201.18@tcp:501: 00000100:00100000:2.0:1789175421.066447:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066240:12345-192.168.201.18@tcp:501: Request processed in 377us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175421.066455:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:3.0:1789175421.076383:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175421.076875:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066368 00000100:00100000:0.0:1789175421.076887:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066368 00000100:00100000:0.0:1789175421.076953:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:0.0:1789175421.076964:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066368:12345-192.168.201.18@tcp:503: 00000100:00100000:0.0:1789175421.077227:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066368:12345-192.168.201.18@tcp:503: Request processed in 264us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175421.077235:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:3.0:1789175421.095917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175421.096094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066496 00000100:00100000:0.0:1789175421.096105:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066496 00000100:00100000:0.0:1789175421.096168:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:0.0:1789175421.096178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:6088:x1876086251066496:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1789175421.097391:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:6088:x1876086251066496:12345-192.168.201.18@tcp:502: Request processed in 1208us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175421.097403:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:3.0:1789175421.105246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175421.105844:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066624 00000100:00100000:2.0:1789175421.105855:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066624 00000100:00100000:2.0:1789175421.105947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:2.0:1789175421.105958:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:6088:x1876086251066624:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175421.106859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:6088:x1876086251066624:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 898us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175421.106869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:3.0:1789175421.115951:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175421.116234:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066752 00000100:00100000:0.0:1789175421.116245:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066752 00000100:00100000:0.0:1789175421.116306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:0.0:1789175421.116318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251066752:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175421.117335:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175421.117395:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700030600/0x1112cdeac4c1668a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2acd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.117430:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700030600/0x1112cdeac4c1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2acd expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.117442:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700030600/0x1112cdeac4c1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2acd expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175421.117450:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700030600, rc 0) 00000100:00100000:0.0:1789175421.118464:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251066752:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 2141us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175421.118484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:3.0:1789175421.123272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175421.124997:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251066880 00000100:00100000:0.0:1789175421.125013:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251066880 00000100:00100000:1.0:1789175421.125324:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:1.0:1789175421.125337:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251066880:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175421.125738:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251066880:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 402us (2475us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789175421.125746:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00010000:00010000:0.0:1789175421.409954:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175422.440143:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789175422.797817:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1e5e4da0 20000000:00000080:3.0:1789175422.797838:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e73b948000 uarg=0000000000000000 20000000:01000000:3.0:1789175422.798138:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789175422.798146:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789175422.798152:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789175422.800543:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789175422.800723:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789175422.810966:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789175422.811035:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789175422.811098:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789175422.811122:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789175422.811150:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811171:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811180:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811187:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811197:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811205:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811260:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811295:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 9 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.811314:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162560:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175422.811518:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811527:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.811538:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162688:0@lo:104: 00000100:00100000:2.0:1789175422.811598:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175422.811647:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811656:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.811665:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162816:0@lo:104: 00000100:00100000:2.0:1789175422.811691:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175422.811731:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.811739:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.811747:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162944:0@lo:104: 00000100:00100000:2.0:1789175422.811780:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175422.813816:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789175422.813873:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175422.813904:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162688 00000100:00100000:0.0:1789175422.813915:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162688 00000100:00100000:0.0:1789175422.813964:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162816 00000100:00100000:0.0:1789175422.813967:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162816 00000100:00100000:0.0:1789175422.813978:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274162944 00000100:00100000:0.0:1789175422.813981:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274162944 00000100:00100000:0.0:1789175422.813995:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789175422.814006:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:8503:x1876086274162688:12345-0@lo:104: 00010000:00010000:0.0:1789175422.814026:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814139:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789175422.814145:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+5:8503:x1876086274162688:12345-0@lo:104: Request processed in 142us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175422.814153:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789175422.814173:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789175422.814180:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:8503:x1876086274162816:12345-0@lo:104: 00010000:00010000:0.0:1789175422.814191:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814229:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789175422.814234:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:8503:x1876086274162816:12345-0@lo:104: Request processed in 56us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175422.814239:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789175422.814277:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789175422.814283:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:8503:x1876086274162944:12345-0@lo:104: 00010000:00010000:0.0:1789175422.814291:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814324:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789175422.814329:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:8503:x1876086274162944:12345-0@lo:104: Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175422.814335:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789175422.814373:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789175422.814380:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814388:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701526a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175422.814400:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814410:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175422.814418:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175422.814424:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789175422.814477:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814484:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175422.814506:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814513:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701526a00/0x1112cdeac4c1652c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16533 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.814517:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789175422.814525:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.814532:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1a00 already unused, calling callback (ffffffffc1ccec20) 00010000:00010000:0.0:1789175422.814532:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789175422.814536:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814536:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814542:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701527c00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175422.814546:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.814550:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814552:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175422.814558:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175422.814564:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1789175422.814568:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175422.814574:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789175422.814586:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814586:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175422.814593:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162688:0@lo:104: 00010000:00010000:1.0:1789175422.814595:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175422.814595:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789175422.814604:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.814605:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.814612:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1a00/0x1112cdeac4c16461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16468 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175422.814613:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162816:0@lo:104: 00010000:00010000:0.0:1789175422.814614:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701527c00/0x1112cdeac4c163ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c16406 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175422.814632:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162944:0@lo:104: 00010000:00010000:1.0:1789175422.814632:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175422.814634:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175422.814635:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175422.814637:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175422.814638:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175422.814642:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175422.814655:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274163072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175422.814665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175422.814693:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175422.814772:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163072 00000100:00100000:3.0:1789175422.814778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163072 00010000:00010000:3.0:1789175422.814802:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 19 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175422.814937:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175422.815051:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175422.819140:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175422.819232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175422.819285:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163200 00000100:00100000:2.0:1789175422.819295:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163200 00010000:00010000:2.0:1789175422.819362:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 20 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.819408:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175422.819419:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3304:x1876086274163072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175422.819436:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175422.819442:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 20 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.822660:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 20 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.822690:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205e200/0x1112cdeac4c16533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1652c expref: 20 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.822716:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175422.822963:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274163072:12345-0@lo:103:ldlm_bl.0 Request processed in 3544us (8266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175422.822975:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175422.823027:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789175422.823041:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3305:x1876086274163200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175422.823063:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175422.823071:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.823080:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.823107:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205e600/0x1112cdeac4c16406 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c163ff expref: 18 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.823117:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175422.823142:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3305:x1876086274163200:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175422.823148:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789175422.823300:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274163072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175422.825256:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1876086274162560:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175422.825307:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175422.826228:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175422.826301:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175422.826403:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163328 00000100:00100000:2.0:1789175422.826412:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163328 00010000:00010000:2.0:1789175422.826456:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 17 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.826494:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067008 00000100:00100000:2.0:1789175422.826498:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067008 00010000:00010000:2.0:1789175422.826514:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175422.826533:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789175422.826544:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3305:x1876086274163328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175422.826564:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175422.826570:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 17 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175422.826642:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789175422.826653:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789175422.826886:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789175422.826898:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1789175422.826908:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251067008:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175422.826932:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175422.826939:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.826964:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 17 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.828595:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.828624:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031000/0x1112cdeac4c165f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a95 expref: 10 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175422.828646:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175422.828741:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:2354:x1876086251067008:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1833us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175422.828753:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00010000:00010000:2.0:1789175422.829678:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031e00/0x1112cdeac4c16468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16461 expref: 17 pid: 5830 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829714:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829725:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829746:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829754:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829762:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829769:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829776:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175422.829781:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829791:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829815:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175422.829833:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175422.829946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3305:x1876086274163328:12345-0@lo:103:ldlm_bl.0 Request processed in 3403us (10713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175422.829964:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789175422.829990:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.829999:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175422.830012:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c16691 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175422.830670:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175422.883264:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175422.883376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175422.883456:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163456 00000100:00100000:1.0:1789175422.883475:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163456 00000100:00100000:1.0:1789175422.883550:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789175422.883562:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274163456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175422.883606:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175422.883658:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274163456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175422.883666:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789175422.883691:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789175422.883730:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734d22680 x1876086274163456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175422.885731:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175423.039872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175423.040258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067136 00000100:00100000:0.0:1789175423.040272:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067136 00000100:00100000:0.0:1789175423.040370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1789175423.040383:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:5596:x1876086251067136:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175423.040416:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175423.040442:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ad4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175423.040490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175423.040504:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175423.040514:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:0.0:1789175423.046068:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251067136:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 5669us (6192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175423.046084:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1789175423.052905:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175423.053068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067264 00000100:00100000:3.0:1789175423.053083:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067264 00000100:00100000:3.0:1789175423.053150:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:3.0:1789175423.053162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251067264:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175423.053611:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251067264:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 449us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175423.053621:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:0.0:1789175423.061021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175423.061495:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067392 00000100:00100000:3.0:1789175423.061510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067392 00000100:00100000:3.0:1789175423.061572:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:3.0:1789175423.061597:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251067392:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175423.062103:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:5596:x1876086251067392:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 318us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175423.062121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:0.0:1789175423.108970:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175423.112515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067520 00000100:00100000:1.0:1789175423.112537:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067520 00000100:00100000:1.0:1789175423.113194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:1.0:1789175423.113210:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:6124:x1876086251067520:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175423.114314:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:6124:x1876086251067520:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 1102us (5352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175423.114327:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:0.0:1789175423.120849:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175423.121023:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067648 00000100:00100000:2.0:1789175423.121036:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067648 00000100:00100000:2.0:1789175423.121111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:2.0:1789175423.121124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:6124:x1876086251067648:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175423.121481:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:6124:x1876086251067648:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 358us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175423.121490:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:3.0:1789175423.396047:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274163584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175423.396139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175423.396245:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163584 00000100:00100000:3.0:1789175423.396254:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163584 00000100:00100000:3.0:1789175423.396319:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789175423.396529:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175423.397796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175423.397818:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274163840:0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.397837:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274164224:0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.398249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175423.398312:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164224 00000100:00100000:0.0:1789175423.398319:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164224 00000100:00100000:0.0:1789175423.398402:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789175423.398414:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.398490:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274164224:12345-0@lo:400:kworker.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175423.398497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789175423.398520:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175423.398560:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274164224:0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.399412:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274164096:0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.399474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175423.399520:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175423.399528:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274163968:0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.399551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175423.399598:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164096 00000100:00100000:0.0:1789175423.399603:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164096 00000100:00100000:0.0:1789175423.399645:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175423.399652:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.399708:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274164096:12345-0@lo:400:kworker.0 Request processed in 56us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175423.399715:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175423.399734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163968 00000100:00100000:0.0:1789175423.399738:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163968 00000100:00100000:3.0:1789175423.401541:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274163584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175423.401592:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175423.401674:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274163584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175423.401682:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789175423.401816:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175423.401829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789175423.401837:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175423.401886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274163968:12345-0@lo:400:kworker.0 Request processed in 50us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175423.401893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789175423.402144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175423.402268:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274163968:0@lo:400:kworker.0 00010000:00080000:0.0:1789175423.402285:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e726704000 x1876086274164096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175423.402296:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274164096:0@lo:400:kworker.0 00010000:00080000:0.0:1789175423.402308:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26ca80 x1876086274163584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175423.402323:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274163584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175423.406997:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163712:0@lo:400:kworker.0 00000100:00100000:1.0:1789175423.407090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175423.407167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163840 00000100:00100000:1.0:1789175423.407177:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163840 00000100:00100000:1.0:1789175423.407232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789175423.407243:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274163840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175423.407307:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274163840:12345-0@lo:400:kworker.0 Request processed in 65us (5164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175423.407315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789175423.407393:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274163840:0@lo:400:kworker.0 00000100:00100000:3.0:1789175423.408148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274163712 00000100:00100000:3.0:1789175423.408154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274163712 00000100:00100000:3.0:1789175423.408197:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789175423.408204:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3305:x1876086274163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175423.408264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3305:x1876086274163712:12345-0@lo:400:kworker.0 Request processed in 59us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175423.408270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789175423.408319:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274163712:0@lo:400:kworker.0 00010000:00010000:0.0:1789175423.458498:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175423.619553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175423.619607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175423.619713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175423.619774:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067776 00000100:00100000:3.0:1789175423.619787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067776 00000100:00100000:3.0:1789175423.619871:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1789175423.619882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251067776:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175423.620019:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068032 00000100:00100000:1.0:1789175423.620024:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068032 00000100:00100000:3.0:1789175423.620037:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251067776:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 157us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175423.620061:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251067904 00000100:00100000:3.0:1789175423.620062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1789175423.620069:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251067904 00000100:00080000:3.0:1789175423.620087:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175423.620087:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00080000:3.0:1789175423.620091:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175423.620094:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175423.620094:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251068032:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175423.620124:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251068032:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175423.620130:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175423.620141:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1789175423.620147:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251067904:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175423.620169:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251067904:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175423.620175:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 10000000:01000000:2.0:1789175424.163858:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789175424.163868:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7264f7000 from 4 10000000:01000000:2.0:1789175424.163875:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175424.163939:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175424.163953:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175424.163966:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175424.164000:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789175424.164088:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175424.164148:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175424.164516:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164352 00000100:00100000:1.0:1789175424.164526:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164352 00000100:00100000:1.0:1789175424.164603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789175424.164614:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274164352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175424.164631:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175424.164646:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1669f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175424.164676:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175424.164689:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175424.164700:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b000, rc 0) 00000100:00100000:1.0:1789175424.164747:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175424.164923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789175424.164980:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175424.164997:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175424.165009:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175424.165078:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175424.165107:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175424.165131:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175424.165176:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164480 00000100:00100000:0.0:1789175424.165181:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164480 00000100:00100000:0.0:1789175424.165216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789175424.165225:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.165582:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175424.165590:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789175424.165625:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.165656:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.165695:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.165711:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030840 going to sleep for 11 seconds 00000100:00100000:0.0:1789175424.165723:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164608 00000100:00100000:0.0:1789175424.165734:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164608 00000100:00100000:0.0:1789175424.165870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789175424.165878:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.166027:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175424.166034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789175424.166071:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.166272:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8558:1876086274164736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.166305:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.166324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164736 00000100:00100000:0.0:1789175424.166327:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164736 00000100:00100000:0.0:1789175424.166372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789175424.166380:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8558:x1876086274164736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.166519:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8558:x1876086274164736:12345-0@lo:502:llog_process_th.0 Request processed in 139us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175424.166526:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789175424.166554:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030540 going to sleep for 11 seconds 00000100:00100000:0.0:1789175424.166697:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8558:1876086274164736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789175424.166723:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175424.166734:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175424.166736:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789175424.166745:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7264f7000 00000020:00000080:0.0:1789175424.166747:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789175424.166912:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8558:1876086274164864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.166946:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.166967:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164864 00000100:00100000:0.0:1789175424.166977:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164864 00000100:00100000:0.0:1789175424.167001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789175424.167007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8558:x1876086274164864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.167117:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:8558:x1876086274164864:12345-0@lo:502:llog_process_th.0 Request processed in 109us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175424.167124:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789175424.167151:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030540 going to sleep for 11 seconds 00000100:00100000:0.0:1789175424.167164:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8558:1876086274164864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789175424.167179:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175424.167183:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175424.167185:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789175424.167188:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789175424.167239:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789175424.167253:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789175424.167262:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175424.167270:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175424.167278:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175424.167280:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73c3b2800 from 4 10000000:01000000:0.0:1789175424.167282:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175424.167303:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175424.167308:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175424.167315:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175424.167330:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.167509:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.167523:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030540 going to sleep for 11 seconds 00000100:00100000:2.0:1789175424.168525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274164992 00000100:00100000:2.0:1789175424.168542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274164992 00000100:00100000:2.0:1789175424.168644:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789175424.168653:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274164992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175424.168667:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175424.168684:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c166ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175424.168715:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175424.168727:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175424.168736:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a0c00, rc 0) 00000100:00100000:2.0:1789175424.168861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274164992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175424.168868:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789175424.169593:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274164992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175424.169622:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175424.169634:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175424.169711:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.169751:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.169786:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030540 going to sleep for 11 seconds 00000100:00100000:0.0:1789175424.169804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165120 00000100:00100000:0.0:1789175424.169808:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165120 00000100:00100000:0.0:1789175424.169841:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789175424.169849:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274165120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.170583:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274165120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 732us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175424.170593:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789175424.170642:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.170676:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.170713:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.170736:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030540 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.172970:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165248 00000100:00100000:3.0:1789175424.172984:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165248 00000100:00100000:3.0:1789175424.173047:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789175424.173056:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274165248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.173309:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274165248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.173317:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789175424.173412:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.175225:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8560:1876086274165376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175424.175310:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175424.175371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165376 00000100:00100000:3.0:1789175424.175378:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165376 00000100:00100000:3.0:1789175424.175421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789175424.175431:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8560:x1876086274165376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175424.177931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8560:x1876086274165376:12345-0@lo:502:llog_process_th.0 Request processed in 2492us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.177947:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789175424.178026:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062aca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.178057:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8560:1876086274165376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175424.178096:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789175424.178108:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175424.178115:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789175424.178123:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e73c3b2800 00000020:00000080:3.0:1789175424.178125:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789175424.178216:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8560:1876086274165504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175424.178263:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175424.178292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165504 00000100:00100000:3.0:1789175424.178298:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165504 00000100:00100000:3.0:1789175424.178336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789175424.178365:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8560:x1876086274165504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175424.179914:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.182006:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:8560:x1876086274165504:12345-0@lo:502:llog_process_th.0 Request processed in 3632us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.182023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789175424.182139:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8560:1876086274165504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175424.182177:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175424.182187:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175424.182189:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789175424.182194:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789175424.182262:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789175424.182284:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175424.182296:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.182310:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175424.182322:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789175424.182324:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7201da000 from 4 10000000:01000000:3.0:1789175424.182327:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175424.182397:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.182412:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.182422:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175424.182456:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.182495:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175424.182525:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.182554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165632 00000100:00100000:3.0:1789175424.184871:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165632 00000100:00100000:3.0:1789175424.184944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789175424.184955:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274165632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175424.184973:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175424.184995:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c166bb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.185028:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.185040:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.185051:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9e00, rc 0) 00000100:00100000:3.0:1789175424.185125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274165632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.185131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789175424.185192:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175424.185212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.185222:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175424.185291:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.185324:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175424.185369:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.185383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165760 00000100:00100000:3.0:1789175424.185387:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165760 00000100:00100000:3.0:1789175424.185408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789175424.185414:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274165760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.187879:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274165760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2334us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.187897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789175424.187999:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.188062:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.188113:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175424.188145:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.188161:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274165888 00000100:00100000:3.0:1789175424.188167:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274165888 00000100:00100000:3.0:1789175424.188205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789175424.188214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274165888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175424.188395:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274165888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.188407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789175424.188454:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274165888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175424.189497:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8564:1876086274166016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.189556:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.189597:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030840 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.189817:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166016 00000100:00100000:3.0:1789175424.189823:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166016 00000100:00100000:3.0:1789175424.189858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789175424.189867:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:8564:x1876086274166016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175424.190052:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:8564:x1876086274166016:12345-0@lo:502:llog_process_th.0 Request processed in 185us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.190061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789175424.190215:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8564:1876086274166016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789175424.190248:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175424.190259:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175424.190262:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789175424.190271:0:8564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7201da000 00000020:00000080:0.0:1789175424.190273:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789175424.190691:0:8564:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8564:1876086274166144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175424.190734:0:8564:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175424.190755:0:8564:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030840 going to sleep for 11 seconds 00000100:00100000:3.0:1789175424.191842:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166144 00000100:00100000:3.0:1789175424.191854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166144 00000100:00100000:3.0:1789175424.191899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789175424.191909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:8564:x1876086274166144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175424.192142:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:8564:x1876086274166144:12345-0@lo:502:llog_process_th.0 Request processed in 234us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175424.192150:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789175424.192678:0:8564:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:8564:1876086274166144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789175424.192720:0:8564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175424.192729:0:8564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175424.192731:0:8564:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789175424.192737:0:8564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789175424.192990:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789175424.193012:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175424.193025:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175424.193039:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175424.481582:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175425.513526:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175426.540385:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175427.555399:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175428.003894:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175428.003928:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274166272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175428.004022:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175428.004107:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166272 00000100:00100000:0.0:1789175428.004117:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166272 00000100:00100000:0.0:1789175428.004185:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789175428.004198:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274166272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175428.004240:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175428.004295:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274166272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175428.004302:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789175428.004327:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789175428.004397:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e3cc000 x1876086274166272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175428.004439:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274166272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175428.514101:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274166400:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.514275:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274166912:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.514358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789175428.514376:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274166528:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.514422:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274167040:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.514579:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274166656:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514609:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.514631:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789175428.514637:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274166784:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.514664:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.516611:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175428.516648:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274167168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175428.516812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175428.516900:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166400 00000100:00100000:1.0:1789175428.516911:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166400 00000100:00100000:1.0:1789175428.516981:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789175428.516994:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274166400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.517062:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274166400:12345-0@lo:400:kworker.0 Request processed in 70us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.517072:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789175428.517114:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166912 00000100:00100000:1.0:1789175428.517120:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166912 00000100:00100000:1.0:1789175428.517174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166528 00000100:00100000:1.0:1789175428.517179:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166528 00000100:00100000:1.0:1789175428.517194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166656 00000100:00100000:1.0:1789175428.517197:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166656 00000100:00100000:1.0:1789175428.517210:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789175428.517216:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274166912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.517251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274166912:12345-0@lo:400:kworker.0 Request processed in 35us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.517257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789175428.517285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789175428.517292:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274166528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.517324:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274166528:12345-0@lo:400:kworker.0 Request processed in 33us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.517331:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789175428.517378:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789175428.517386:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.520023:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274166656:12345-0@lo:400:kworker.0 Request processed in 2622us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.520041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789175428.520099:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167040 00000100:00100000:1.0:1789175428.520111:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167040 00000100:00100000:1.0:1789175428.520248:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274166784 00000100:00100000:1.0:1789175428.520253:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274166784 00000100:00100000:1.0:1789175428.520271:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789175428.520280:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.520393:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274167040:12345-0@lo:400:kworker.0 Request processed in 114us (5931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.520400:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789175428.520412:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175428.520419:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.520454:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274166784:12345-0@lo:400:kworker.0 Request processed in 36us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.520459:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175428.520597:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167168 00000100:00100000:1.0:1789175428.520603:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167168 00000100:00100000:1.0:1789175428.520633:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789175428.520653:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274167168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175428.520753:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175428.520798:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274167168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (3987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.520805:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789175428.520829:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175428.520834:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789175428.522253:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733d07b80 x1876086274167168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175428.522291:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274167168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175428.522914:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274166528:0@lo:400:kworker.0 00010000:00080000:1.0:1789175428.522932:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734d23480 x1876086274167040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175428.522942:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274167040:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.522953:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274166400:0@lo:400:kworker.0 00000100:00100000:1.0:1789175428.522965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274166912:0@lo:400:kworker.0 00000100:00100000:0.0:1789175428.523554:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274166656:0@lo:400:kworker.0 00010000:00080000:0.0:1789175428.523585:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734d22a00 x1876086274166784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175428.523596:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274166784:0@lo:400:kworker.0 00010000:00010000:2.0:1789175428.581232:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175428.742112:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175428.742159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175428.742192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175428.742220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175428.742250:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068544 00000100:00100000:2.0:1789175428.742260:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068544 00000100:00100000:2.0:1789175428.742329:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068416 00000100:00100000:2.0:1789175428.742332:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068416 00000100:00100000:2.0:1789175428.742384:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175428.742394:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251068544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175428.742468:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251068544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175428.742476:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175428.742491:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175428.742497:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251068416:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175428.742520:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251068416:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175428.742526:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175428.742542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068160 00000100:00100000:2.0:1789175428.742545:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068160 00000100:00100000:2.0:1789175428.742567:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:2.0:1789175428.742573:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251068160:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175428.742608:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251068160:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175428.742615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00080000:2.0:1789175428.742643:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789175428.742647:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175428.742921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068288 00000100:00100000:1.0:1789175428.742927:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068288 00000100:00100000:1.0:1789175428.742987:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175428.742995:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251068288:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175428.743029:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251068288:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 36us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175428.743036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00080000:2.0:1789175428.743924:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789175429.542939:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789175429.603713:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175430.626577:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175431.654558:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175432.673526:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175433.123520:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274167296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175433.123602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175433.123672:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167296 00000100:00100000:2.0:1789175433.123680:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167296 00000100:00100000:2.0:1789175433.123735:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789175433.123745:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274167296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175433.123779:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175433.123822:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274167296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175433.123829:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789175433.123849:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789175433.123878:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34380 x1876086274167296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175433.123895:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274167296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175433.634607:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274167424:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.634688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.634735:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274167936:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.634763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.634798:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175433.634804:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274167552:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.634829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.634868:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274167680:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.634893:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.634913:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175433.634918:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274167808:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.634941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.634973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167424 00000100:00100000:3.0:1789175433.634980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167424 00000100:00100000:3.0:1789175433.635025:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789175433.635034:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274167424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274167424:12345-0@lo:400:kworker.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175433.635089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789175433.635119:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167552 00000100:00100000:3.0:1789175433.635123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167552 00000100:00100000:3.0:1789175433.635147:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167680 00000100:00100000:3.0:1789175433.635150:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167680 00000100:00100000:0.0:1789175433.635229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789175433.635241:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274167552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167808 00000100:00100000:3.0:1789175433.635254:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167808 00000100:00100000:3.0:1789175433.635292:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789175433.635294:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274167552:12345-0@lo:400:kworker.0 Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175433.635299:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274167680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175433.635300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789175433.635314:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789175433.635332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274167680:12345-0@lo:400:kworker.0 Request processed in 35us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175433.635332:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274167808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789175433.635378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274167808:12345-0@lo:400:kworker.0 Request processed in 58us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175433.635383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789175433.635390:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175433.635716:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274167808:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635728:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274167680:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635805:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274167552:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635813:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274167424:0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635848:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274167936 00000100:00100000:3.0:1789175433.635852:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274167936 00000100:00100000:3.0:1789175433.635889:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789175433.635895:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274167936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175433.635935:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274167936:12345-0@lo:400:kworker.0 Request processed in 41us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175433.635942:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789175433.635957:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789175433.635974:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26d180 x1876086274167936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175433.635987:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274167936:0@lo:400:kworker.0 00000100:00100000:2.0:1789175433.638839:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274168064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175433.638910:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175433.638985:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168064 00000100:00100000:3.0:1789175433.638992:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168064 00000100:00100000:3.0:1789175433.639041:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789175433.639050:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274168064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175433.639087:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175433.640322:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274168064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1267us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175433.640424:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789175433.640590:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26d180 x1876086274168064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175433.640612:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274168064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789175433.699698:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789175433.814919:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing yml_node 00000100:00100000:1.0:1789175433.869923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175433.869975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175433.870008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175433.870050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068672 00000100:00100000:3.0:1789175433.870061:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068672 00000100:00100000:3.0:1789175433.870110:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:3.0:1789175433.870120:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251068672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175433.870192:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251068672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175433.870200:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:0.0:1789175433.870522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068800 00000100:00100000:0.0:1789175433.870528:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068800 00000100:00100000:0.0:1789175433.870717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1789175433.870726:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251068800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175433.870766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251068800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175433.870772:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00080000:3.0:1789175433.871015:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175433.875333:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251068928 00000100:00100000:2.0:1789175433.875372:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251068928 00000100:00100000:2.0:1789175433.875457:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175433.875469:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2352:x1876086251068928:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:2.0:1789175433.875504:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165fe 00000100:00080000:2.0:1789175433.875514:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e73be0b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789175433.875554:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1789175433.876049:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175433.876254:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+2:2352:x1876086251068928:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 786us (6243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175433.876263:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1789175433.878191:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1789175433.878490:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175433.882970:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069056 00000100:00100000:0.0:1789175433.882985:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069056 00000100:00100000:0.0:1789175433.883075:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175433.883089:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2352:x1876086251069056:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:0.0:1789175433.883130:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16605 00000100:00080000:0.0:1789175433.883140:0:6687:0:(import.c:65:import_set_state_nolock()) ffff97e73be08800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789175433.883183:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789175433.883749:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+2:2352:x1876086251069056:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 661us (5565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175433.883760:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:0.0:1789175433.883819:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175433.884289:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789175434.724580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175435.745703:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175436.769876:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175437.793589:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789175438.019331:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:2.0:1789175438.246823:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274168192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175438.246916:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175438.246996:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168192 00000100:00100000:2.0:1789175438.247004:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168192 00000100:00100000:2.0:1789175438.247062:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175438.247073:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274168192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175438.247117:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175438.247171:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274168192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.247177:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789175438.247208:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789175438.247299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d37800 x1876086274168192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175438.247817:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274168192:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789175438.339852:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175438.339865:0:7644:0:(genops.c:885:class_export_put()) final put ffff97e73be0d800/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:0.0:1789175438.340298:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73be0d800/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-OST0001 00000020:00000080:0.0:1789175438.340540:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73be08800 for lustre-OST0001 00000100:00100000:2.0:1789175438.753555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274168320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175438.753781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175438.753876:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168320 00000100:00100000:2.0:1789175438.753883:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168320 00000100:00100000:2.0:1789175438.753944:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789175438.753955:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274168320:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789175438.754025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789175438.754047:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175438.754099:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274168320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.754107:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175438.754126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274168448:0@lo:400:kworker.0 00000100:00100000:2.0:1789175438.754137:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274168832:0@lo:400:kworker.0 00000100:00100000:0.0:1789175438.754170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175438.754179:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789175438.754231:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26c000 x1876086274168320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175438.754233:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175438.754243:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274168576:0@lo:400:kworker.0 00000100:00100000:2.0:1789175438.754256:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274168320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175438.754273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175438.754277:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175438.754284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274168704:0@lo:400:kworker.0 00000100:00100000:0.0:1789175438.754308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168448 00000100:00100000:0.0:1789175438.754313:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168448 00000100:00100000:2.0:1789175438.754314:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175438.754368:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168832 00000100:00100000:2.0:1789175438.754372:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168832 00000100:00100000:0.0:1789175438.754377:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789175438.754387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274168448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175438.754411:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168576 00000100:00100000:2.0:1789175438.754415:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168576 00000100:00100000:2.0:1789175438.754430:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168704 00000100:00100000:0.0:1789175438.754433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274168448:12345-0@lo:400:kworker.0 Request processed in 46us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.754434:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168704 00000100:00100000:0.0:1789175438.754444:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789175438.754456:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789175438.754466:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274168832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175438.754484:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789175438.754499:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274168576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175438.754510:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274168832:12345-0@lo:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.754518:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789175438.754536:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789175438.754542:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274168576:12345-0@lo:400:kworker.0 Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.754546:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274168704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175438.754556:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789175438.754598:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274168704:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175438.754605:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789175438.754608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274168576:0@lo:400:kworker.0 00000100:00100000:0.0:1789175438.754622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274168448:0@lo:400:kworker.0 00000100:00100000:3.0:1789175438.761824:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274168704:0@lo:400:kworker.0 00000100:00100000:3.0:1789175438.761851:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274168832:0@lo:400:kworker.0 00000100:00080000:2.0:1789175438.765228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789175438.825579:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789175438.841444:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175438.841457:0:6713:0:(genops.c:885:class_export_put()) final put ffff97e73be0a800/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:0.0:1789175438.841581:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73be0a800/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-OST0000 00000020:00000080:0.0:1789175438.841647:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73be0b800 for lustre-OST0000 00000100:00100000:0.0:1789175438.975743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175438.975780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175438.976024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069184 00000100:00100000:3.0:1789175438.976035:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069184 00000100:00100000:3.0:1789175438.976149:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:3.0:1789175438.976160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251069184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175438.976240:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251069184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 81us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175438.976248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:1.0:1789175438.979422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069312 00000100:00100000:1.0:1789175438.979440:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069312 00000100:00100000:1.0:1789175438.979527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1789175438.979537:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251069312:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175438.979629:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251069312:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175438.979637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00080000:3.0:1789175438.981636:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789175439.844511:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789175440.187695:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1789175440.865676:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175441.889732:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789175442.709906:0:9436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1789175442.917474:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175443.363812:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789175443.363852:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274168960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175443.363946:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.364277:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274168960 00000100:00100000:3.0:1789175443.364289:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274168960 00000100:00100000:3.0:1789175443.364385:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789175443.364398:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274168960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175443.364444:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175443.364498:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274168960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.364505:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789175443.364565:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789175443.366525:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d36300 x1876086274168960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175443.366557:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274168960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175443.873661:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274169088:0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.873743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.873804:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274169472:0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.873806:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274169600:0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.873851:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.873857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.873894:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274169216:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.873919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.873941:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175443.873947:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274169344:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.873974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175443.873995:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169088 00000100:00100000:0.0:1789175443.874004:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169088 00000100:00100000:3.0:1789175443.874011:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169472 00000100:00100000:3.0:1789175443.874018:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169472 00000100:00100000:0.0:1789175443.874052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789175443.874063:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274169088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.874085:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169216 00000100:00100000:3.0:1789175443.874090:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169216 00000100:00100000:3.0:1789175443.874120:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169344 00000100:00100000:3.0:1789175443.874123:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169344 00000100:00100000:0.0:1789175443.874129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274169088:12345-0@lo:400:kworker.0 Request processed in 68us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175443.874138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789175443.874141:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789175443.874151:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274169472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.874179:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169600 00000100:00100000:0.0:1789175443.874193:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169600 00000100:00100000:3.0:1789175443.874196:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274169472:12345-0@lo:400:kworker.0 Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.874213:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789175443.874228:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789175443.874235:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274169216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.874249:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789175443.874258:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274169600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.874273:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274169216:12345-0@lo:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.874281:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789175443.874295:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789175443.874301:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274169600:12345-0@lo:400:kworker.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.874304:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274169344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.874314:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789175443.874377:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c26d180 x1876086274169600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175443.874391:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274169600:0@lo:400:kworker.0 00000100:00100000:0.0:1789175443.874402:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274169088:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.874462:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274169344:12345-0@lo:400:kworker.0 Request processed in 159us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.874469:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789175443.874491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175443.874496:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175443.874885:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274169472:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.874912:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274169344:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.874920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274169216:0@lo:400:kworker.0 00000100:00100000:3.0:1789175443.877580:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175443.877600:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274169728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175443.877669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175443.877718:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169728 00000100:00100000:3.0:1789175443.877725:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169728 00000100:00100000:3.0:1789175443.877776:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789175443.877785:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274169728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175443.877820:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175443.877872:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274169728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175443.877879:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789175443.877932:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e7071d4000 x1876086274169728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175443.877950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274169728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789175443.937651:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175444.098658:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175444.098713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175444.098750:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069440 00000100:00100000:3.0:1789175444.098768:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069440 00000100:00100000:2.0:1789175444.098843:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069568 00000100:00100000:3.0:1789175444.098854:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:2.0:1789175444.098857:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069568 00000100:00100000:3.0:1789175444.098869:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251069440:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175444.098955:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:2.0:1789175444.098968:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251069568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175444.098980:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2353:x1876086251069440:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175444.098989:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:2.0:1789175444.099055:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251069568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 88us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175444.099065:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00080000:1.0:1789175444.099171:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789175444.288997:0:9484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 21:10:43 EDT 2026 00010000:00010000:3.0:1789175444.961743:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175445.986516:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175447.014153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175448.039080:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175448.481707:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175448.481738:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274169856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175448.481829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175448.501876:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169856 00000100:00100000:1.0:1789175448.501894:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169856 00000100:00100000:1.0:1789175448.502009:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789175448.502032:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274169856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175448.502081:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789175448.502082:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789175448.502712:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34a80 x1876086274169856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175448.502743:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274169856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175448.504028:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274169856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1981us (22180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175448.504043:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175448.993932:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274169984:0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.993975:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274170368:0@lo:400:kworker.0 00000100:00100000:0.0:1789175448.994018:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274170112:0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.994078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175448.994163:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175448.994169:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274170240:0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.994193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175448.994229:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175448.994252:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175448.994260:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170368 00000100:00100000:2.0:1789175448.994269:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170368 00000100:00100000:0.0:1789175448.994277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175448.994299:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175448.994321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274170496:0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.994331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170240 00000100:00100000:2.0:1789175448.994334:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170240 00000100:00100000:0.0:1789175448.994366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175448.994373:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170112 00000100:00100000:2.0:1789175448.994375:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170112 00000100:00100000:2.0:1789175448.994393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789175448.994402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274170368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.994468:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274170368:12345-0@lo:400:kworker.0 Request processed in 67us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175448.994818:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170624 00000100:00100000:0.0:1789175448.994824:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170624 00000100:00100000:1.0:1789175448.994920:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175448.994931:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274170240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175448.994974:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274170240:12345-0@lo:400:kworker.0 Request processed in 47us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175448.994981:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175448.995002:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789175448.995019:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274170112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175448.995053:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274170112:12345-0@lo:400:kworker.0 Request processed in 45us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175448.995059:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789175448.995085:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789175448.995092:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274170624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175448.995126:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175448.995161:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274170624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175448.995167:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175448.995516:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789175448.995664:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170496 00000100:00100000:0.0:1789175448.995670:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170496 00000100:00100000:0.0:1789175448.995704:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789175448.995711:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274170496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175448.995750:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274170496:12345-0@lo:400:kworker.0 Request processed in 40us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175448.995755:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175448.995761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274170240:0@lo:400:kworker.0 00000100:00100000:2.0:1789175448.995778:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274170368:0@lo:400:kworker.0 00010000:00080000:0.0:1789175448.995805:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d35f80 x1876086274170496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175448.995817:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274170496:0@lo:400:kworker.0 00000100:00100000:0.0:1789175448.995828:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274170112:0@lo:400:kworker.0 00000100:00080000:2.0:1789175448.995831:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789175448.995837:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789175448.995837:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734264000 x1876086274170624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175448.995852:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274170624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175448.996029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175448.997766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274169984 00000100:00100000:3.0:1789175448.997781:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274169984 00000100:00100000:3.0:1789175448.997850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789175448.997869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274169984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175449.000868:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274169984:12345-0@lo:400:kworker.0 Request processed in 106us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175449.000888:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789175449.001074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274169984:0@lo:400:kworker.0 00010000:00010000:3.0:1789175449.060863:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175449.222625:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175449.222688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175449.222734:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069824 00000100:00100000:1.0:1789175449.222747:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069824 00000100:00100000:1.0:1789175449.222826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1789175449.222840:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251069824:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175449.222946:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251069824:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175449.222955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00080000:1.0:1789175449.222982:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175449.227490:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069696 00000100:00100000:3.0:1789175449.227513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069696 00000100:00100000:3.0:1789175449.227759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:3.0:1789175449.227774:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251069696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175449.227887:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251069696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 118us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175449.227896:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00010000:00010000:0.0:1789175450.081620:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175451.105618:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175452.129751:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175453.155695:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175453.605381:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175453.605414:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274170752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175453.605529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175453.605625:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170752 00000100:00100000:1.0:1789175453.605635:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170752 00000100:00100000:1.0:1789175453.605708:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789175453.605719:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274170752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175453.605768:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175453.605819:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274170752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175453.605827:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789175453.605865:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789175453.605901:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d36d80 x1876086274170752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175453.605925:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274170752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175454.114284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274170880:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114499:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274171392:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175454.114594:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274171264:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114659:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274171008:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114715:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274171520:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114754:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175454.114758:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274171136:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.114778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.114852:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274170880 00000100:00100000:0.0:1789175454.114861:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274170880 00000100:00100000:0.0:1789175454.114929:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789175454.114941:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274170880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115009:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274170880:12345-0@lo:400:kworker.0 Request processed in 70us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115017:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789175454.115058:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171264 00000100:00100000:0.0:1789175454.115062:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171264 00000100:00100000:0.0:1789175454.115092:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171520 00000100:00100000:0.0:1789175454.115095:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171520 00000100:00100000:0.0:1789175454.115121:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175454.115128:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274171264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115162:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274171264:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115168:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789175454.115179:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789175454.115185:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274171520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115222:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274171520:12345-0@lo:400:kworker.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115228:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789175454.115253:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171392 00000100:00100000:0.0:1789175454.115256:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171392 00000100:00100000:0.0:1789175454.115285:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171008 00000100:00100000:0.0:1789175454.115288:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171008 00000100:00100000:0.0:1789175454.115299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171136 00000100:00100000:0.0:1789175454.115301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171136 00000100:00100000:0.0:1789175454.115317:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789175454.115323:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274171392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115382:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274171392:12345-0@lo:400:kworker.0 Request processed in 59us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115388:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789175454.115399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789175454.115405:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274171008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274171008:12345-0@lo:400:kworker.0 Request processed in 27us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115437:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789175454.115448:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789175454.115453:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274171136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115479:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274171136:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115484:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789175454.115509:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789175454.115514:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175454.115529:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274171648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175454.115566:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175454.115603:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171648 00000100:00100000:0.0:1789175454.115607:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171648 00000100:00100000:0.0:1789175454.115633:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789175454.115640:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274171648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789175454.115673:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175454.115710:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274171648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175454.115716:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789175454.115757:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734377480 x1876086274171648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175454.115786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274171648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175454.115818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274171136:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274171008:0@lo:400:kworker.0 00010000:00080000:0.0:1789175454.115838:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e3cdc00 x1876086274171520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175454.115847:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274171520:0@lo:400:kworker.0 00010000:00080000:0.0:1789175454.115889:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734264000 x1876086274171264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175454.115898:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274171264:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115908:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274170880:0@lo:400:kworker.0 00000100:00100000:0.0:1789175454.115929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274171392:0@lo:400:kworker.0 00010000:00010000:2.0:1789175454.178534:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175454.340251:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175454.340311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175454.340481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251069952 00000100:00100000:3.0:1789175454.340494:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251069952 00000100:00100000:3.0:1789175454.340563:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:3.0:1789175454.340576:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251069952:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175454.340674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2354:x1876086251069952:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175454.340683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:2.0:1789175454.341068:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070080 00000100:00100000:2.0:1789175454.341074:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070080 00000100:00100000:2.0:1789175454.341139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1789175454.341148:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251070080:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175454.341194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251070080:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 47us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175454.341207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00080000:0.0:1789175454.341401:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789175455.203025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175456.230644:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175457.250436:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175458.273855:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175458.723223:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274171776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175458.723875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175458.724465:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171776 00000100:00100000:0.0:1789175458.724478:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171776 00000100:00100000:0.0:1789175458.724573:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789175458.724589:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274171776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175458.724768:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175458.724865:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274171776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 281us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175458.724874:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789175458.724944:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789175458.725042:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34000 x1876086274171776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175458.725068:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274171776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175459.235689:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274172288:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.235797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.235879:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789175459.235886:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274171904:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.235917:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.235939:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274172416:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.235975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.236004:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274172160:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236028:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.236048:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789175459.236054:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274172032:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.236088:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274172544:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175459.236136:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172288 00000100:00100000:3.0:1789175459.236145:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172288 00000100:00100000:3.0:1789175459.236202:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172544 00000100:00100000:3.0:1789175459.236206:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172544 00000100:00100000:3.0:1789175459.236237:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789175459.236247:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274172288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236307:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274172288:12345-0@lo:400:kworker.0 Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236314:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789175459.236333:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175459.236360:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274172544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236393:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274172544:12345-0@lo:400:kworker.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236399:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175459.236415:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274171904 00000100:00100000:3.0:1789175459.236418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274171904 00000100:00100000:3.0:1789175459.236442:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789175459.236449:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274171904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236488:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274171904:12345-0@lo:400:kworker.0 Request processed in 40us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789175459.236521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172416 00000100:00100000:3.0:1789175459.236525:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172416 00000100:00100000:3.0:1789175459.236549:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172160 00000100:00100000:3.0:1789175459.236551:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172160 00000100:00100000:3.0:1789175459.236562:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172032 00000100:00100000:3.0:1789175459.236565:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172032 00000100:00100000:3.0:1789175459.236580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789175459.236585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274172416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274172416:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236620:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789175459.236631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789175459.236637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236663:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274172160:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236669:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789175459.236679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789175459.236685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274172032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236710:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274172032:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.236716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789175459.236750:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789175459.236755:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175459.236806:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274172032:0@lo:400:kworker.0 00010000:00080000:3.0:1789175459.236846:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbf480 x1876086274172544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175459.236859:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274172544:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236869:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274172160:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236904:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274171904:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.236914:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274172416:0@lo:400:kworker.0 00010000:00080000:3.0:1789175459.236924:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e7071d4700 x1876086274172288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175459.236934:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274172288:0@lo:400:kworker.0 00000100:00100000:3.0:1789175459.240538:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274172672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175459.240639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175459.240803:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172672 00000100:00100000:2.0:1789175459.240813:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172672 00000100:00100000:2.0:1789175459.240900:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789175459.240914:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274172672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175459.240960:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175459.241255:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274172672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 342us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175459.241264:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789175459.241386:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34000 x1876086274172672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175459.241411:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274172672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789175459.297482:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175459.464481:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175459.464533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175459.464574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070336 00000100:00100000:3.0:1789175459.464585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070336 00000100:00100000:3.0:1789175459.464668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1789175459.464680:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251070336:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175459.464790:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251070336:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175459.464815:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1789175459.464945:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070208 00000100:00100000:1.0:1789175459.464962:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070208 00000100:00100000:1.0:1789175459.465002:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:1.0:1789175459.465009:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251070208:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175459.465038:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2355:x1876086251070208:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175459.465044:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00080000:3.0:1789175459.465211:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789175460.062011:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:10:59 (1789175459) === 00010000:00010000:3.0:1789175460.323767:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175460.576716:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.588612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070464 00000100:00100000:3.0:1789175460.588635:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070464 00000100:00100000:3.0:1789175460.588843:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:3.0:1789175460.588858:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:8145:x1876086251070464:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789175460.588881:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175460.588908:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f8600/0x1112cdeac4c166c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2adb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175460.591775:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f8600/0x1112cdeac4c166c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2adb expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175460.591816:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f8600/0x1112cdeac4c166c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2adb expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175460.591839:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8600, rc 0) 00000100:00100000:3.0:1789175460.592157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251070464:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 3299us (15455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175460.592169:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:3.0:1789175460.613629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.614117:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070592 00000100:00100000:1.0:1789175460.614152:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070592 00000100:00100000:1.0:1789175460.614232:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:1.0:1789175460.614245:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251070592:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789175460.615232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251070592:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 983us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.615247:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:0.0:1789175460.638850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.639068:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070720 00000100:00100000:3.0:1789175460.639082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070720 00000100:00100000:3.0:1789175460.639159:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:3.0:1789175460.639172:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251070720:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789175460.643774:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251070720:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 4587us (5031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.643798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:2.0:1789175460.651997:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.652900:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070848 00000100:00100000:1.0:1789175460.652918:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070848 00000100:00100000:1.0:1789175460.652994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:1.0:1789175460.653007:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8149:x1876086251070848:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175460.653407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8149:x1876086251070848:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 402us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.653417:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:3.0:1789175460.679594:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175460.680300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251070976 00000100:00100000:2.0:1789175460.680325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251070976 00000100:00100000:2.0:1789175460.680440:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:2.0:1789175460.680452:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8149:x1876086251070976:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175460.681500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8149:x1876086251070976:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 1041us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.681514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:0.0:1789175460.686902:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.687680:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071104 00000100:00100000:1.0:1789175460.687696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071104 00000100:00100000:1.0:1789175460.687764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:1.0:1789175460.687776:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:8145:x1876086251071104:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789175460.687797:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175460.687829:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a800/0x1112cdeac4c166d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b05 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175460.687870:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a800/0x1112cdeac4c166d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b05 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175460.687885:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a800/0x1112cdeac4c166d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b05 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175460.687920:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a800, rc 0) 00000100:00100000:1.0:1789175460.688120:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:8145:x1876086251071104:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 345us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.688129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:3.0:1789175460.691290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175460.691800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071232 00000100:00100000:0.0:1789175460.691876:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071232 00000100:00100000:0.0:1789175460.692173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:0.0:1789175460.692187:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:8145:x1876086251071232:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789175460.692223:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789175460.692255:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789175460.692260:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789175460.692263:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789175460.692266:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789175460.694783:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:8145:x1876086251071232:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 2584us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175460.694812:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:3.0:1789175460.697925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175460.698224:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071360 00000100:00100000:2.0:1789175460.698237:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071360 00000100:00100000:2.0:1789175460.698305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:2.0:1789175460.698318:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:8145:x1876086251071360:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789175460.698386:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175460.698412:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b0c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175460.698451:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175460.698465:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175460.698495:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1a00, rc 0) 00000100:00100000:2.0:1789175460.698573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8145:x1876086251071360:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 256us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.698581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:3.0:1789175460.703639:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175460.704076:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071488 00000100:00100000:0.0:1789175460.704090:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071488 00000100:00100000:0.0:1789175460.704186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:0.0:1789175460.704198:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8145:x1876086251071488:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789175460.704743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8145:x1876086251071488:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 546us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175460.704755:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:3.0:1789175460.706792:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175460.707198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071616 00000100:00100000:2.0:1789175460.707218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071616 00000100:00100000:2.0:1789175460.707289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:2.0:1789175460.707301:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8145:x1876086251071616:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789175460.707601:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8145:x1876086251071616:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 302us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.707611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1789175460.710607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175460.710898:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071744 00000100:00100000:0.0:1789175460.710912:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071744 00000100:00100000:0.0:1789175460.711200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:0.0:1789175460.711372:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8153:x1876086251071744:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789175460.711729:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8153:x1876086251071744:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 518us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175460.711754:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:3.0:1789175460.716563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.716753:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251071872 00000100:00100000:1.0:1789175460.716767:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251071872 00000100:00100000:1.0:1789175460.716853:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:1.0:1789175460.716866:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8153:x1876086251071872:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175460.717672:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:8153:x1876086251071872:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 806us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.717683:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:3.0:1789175460.729974:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.731556:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175460.737180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072000 00000100:00100000:2.0:1789175460.737201:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072000 00000100:00100000:2.0:1789175460.737323:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072384 00000100:00100000:2.0:1789175460.737327:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072384 00000100:00100000:2.0:1789175460.737464:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1789175460.737476:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251072384:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175460.737590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251072384:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 116us (6043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.737598:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1789175460.737619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175460.737623:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876086251072000:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789175460.737652:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 15bde859-e823-4861-b8b2-68ba9f4f9050@192.168.201.18@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1789175460.737698:0:5840:0:(genops.c:1385:class_connect()) connect: client 15bde859-e823-4861-b8b2-68ba9f4f9050, cookie 0x1112cdeac4c166de 00000004:00100000:2.0:1789175460.737765:0:5840:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789175460.738328:0:5840:0:(import.c:65:import_set_state_nolock()) ffff97e73465d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789175460.738405:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2352:x1876086251072000:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 779us (8449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.738414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1789175460.744384:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.745174:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072128 00000100:00100000:1.0:1789175460.745187:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072128 00000100:00100000:1.0:1789175460.745406:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1789175460.745418:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:0:x1876086251072128:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789175460.745476:0:8054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789175460.745593:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:0:x1876086251072128:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 178us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.745601:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00080000:3.0:1789175460.746153:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175460.751690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.753548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072256 00000100:00100000:3.0:1789175460.753572:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072256 00000100:00100000:3.0:1789175460.753657:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175460.753670:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072256:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789175460.753712:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789175460.753843:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072256:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 175us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175460.753850:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1789175460.758425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175460.758515:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072512 00000100:00100000:1.0:1789175460.758527:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072512 00000100:00100000:1.0:1789175460.758587:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175460.758596:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072512:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789175460.758708:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072512:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175460.758731:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1789175460.761796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175460.761856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.761876:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072640 00000100:00100000:3.0:1789175460.761890:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072640 00000100:00100000:3.0:1789175460.761957:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072768 00000100:00100000:3.0:1789175460.761961:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072768 00000100:00100000:3.0:1789175460.761979:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175460.761990:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251072640:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789175460.762036:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 15bde859-e823-4861-b8b2-68ba9f4f9050@192.168.201.18@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1789175460.762270:0:6686:0:(genops.c:1385:class_connect()) connect: client 15bde859-e823-4861-b8b2-68ba9f4f9050, cookie 0x1112cdeac4c166e5 00002000:00100000:3.0:1789175460.762286:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15bde859-e823-4861-b8b2-68ba9f4f9050/ffff97e734cd1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789175460.762316:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789175460.762699:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789175460.762867:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e734cd7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789175460.763221:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2352:x1876086251072640:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 1230us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175460.763231:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175460.763264:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1789175460.763271:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251072768:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789175460.763297:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 15bde859-e823-4861-b8b2-68ba9f4f9050@192.168.201.18@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1789175460.763321:0:6686:0:(genops.c:1385:class_connect()) connect: client 15bde859-e823-4861-b8b2-68ba9f4f9050, cookie 0x1112cdeac4c166ec 00002000:00100000:3.0:1789175460.763328:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15bde859-e823-4861-b8b2-68ba9f4f9050/ffff97e734cd1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789175460.763337:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789175460.763614:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789175460.763696:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e73465b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789175460.763729:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2352:x1876086251072768:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 457us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175460.763737:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1789175460.766393:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175460.767690:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251072896 00000100:00100000:3.0:1789175460.767706:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251072896 00000100:00100000:3.0:1789175460.767798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1789175460.767824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072896:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789175460.768174:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789175460.768296:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:8145:x1876086251072896:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 475us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175460.768305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00010000:00010000:3.0:1789175461.350740:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175462.372386:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175463.395420:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789175463.411130:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00000100:00100000:2.0:1789175463.841690:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274172800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175463.841797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175463.841889:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172800 00000100:00100000:2.0:1789175463.841899:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172800 00000100:00100000:2.0:1789175463.841968:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789175463.841979:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274172800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175463.842024:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175463.842079:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274172800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175463.842088:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789175463.842117:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789175463.842176:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34000 x1876086274172800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175463.842216:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274172800:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789175463.914018:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00000100:00100000:1.0:1789175464.357104:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274173056:0@lo:400:kworker.0 00000100:00100000:1.0:1789175464.357176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175464.357187:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274172928:0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175464.357230:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274173568:0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357241:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274173440:0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175464.357267:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175464.357279:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175464.357283:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175464.357284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274173312:0@lo:400:kworker.0 00000100:00100000:1.0:1789175464.357287:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274173184:0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357306:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175464.357306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175464.357333:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173056 00000100:00100000:1.0:1789175464.357360:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173056 00000100:00100000:3.0:1789175464.357365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173440 00000100:00100000:3.0:1789175464.357368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173440 00000100:00100000:3.0:1789175464.357399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173184 00000100:00100000:3.0:1789175464.357401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173184 00000100:00100000:1.0:1789175464.357404:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789175464.357413:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274173056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789175464.357419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274173440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.357460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274173440:12345-0@lo:400:kworker.0 Request processed in 39us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175464.357460:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274173056:12345-0@lo:400:kworker.0 Request processed in 47us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175464.357467:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789175464.357591:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173568 00000100:00100000:2.0:1789175464.357595:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173568 00000100:00100000:2.0:1789175464.357626:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173312 00000100:00100000:2.0:1789175464.357629:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173312 00000100:00100000:2.0:1789175464.357646:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175464.357652:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274173568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175464.357695:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274173568:12345-0@lo:400:kworker.0 Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175464.357702:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175464.357717:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789175464.357723:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274173312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175464.357764:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274173312:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175464.357770:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789175464.358277:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789175464.358306:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789175464.358314:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274173184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175464.358635:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274173184:12345-0@lo:400:kworker.0 Request processed in 321us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175464.358643:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789175464.358685:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274173184:0@lo:400:kworker.0 00010000:00080000:1.0:1789175464.358701:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbdf80 x1876086274173568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175464.358726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274173568:0@lo:400:kworker.0 00000100:00100000:1.0:1789175464.358750:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274173056:0@lo:400:kworker.0 00000100:00100000:1.0:1789175464.358778:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175464.358784:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274173696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175464.358815:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175464.358847:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173696 00000100:00100000:1.0:1789175464.358852:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173696 00000100:00100000:1.0:1789175464.358883:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789175464.358890:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274173696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175464.358921:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175464.358956:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274173696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175464.358962:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789175464.358988:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d34000 x1876086274173696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175464.359003:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274173696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175464.360573:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274172928 00000100:00100000:3.0:1789175464.360586:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274172928 00000100:00100000:3.0:1789175464.360634:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789175464.360644:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274172928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175464.360797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274172928:12345-0@lo:400:kworker.0 Request processed in 155us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175464.360804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1789175464.360846:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175464.360854:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789175464.361541:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbc000 x1876086274173312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175464.361558:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274173312:0@lo:400:kworker.0 00000100:00100000:2.0:1789175464.361571:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274172928:0@lo:400:kworker.0 00000100:00100000:2.0:1789175464.361585:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274173440:0@lo:400:kworker.0 00010000:00010000:0.0:1789175464.437074:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789175464.499786:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00010000:00010000:3.0:1789175465.444276:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175466.111965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175466.112021:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175466.112090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175466.112114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175466.112143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175466.112338:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073280 00000100:00100000:1.0:1789175466.112378:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073280 00000100:00100000:1.0:1789175466.112452:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073152 00000100:00100000:1.0:1789175466.112456:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073152 00000100:00100000:1.0:1789175466.112482:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1789175466.112493:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073280:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175466.112582:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073280:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 90us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175466.112603:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1789175466.112625:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:1.0:1789175466.112633:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251073152:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175466.112664:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251073152:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175466.112671:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1789175466.112857:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073536 00000100:00100000:2.0:1789175466.112862:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073536 00000100:00100000:2.0:1789175466.112912:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073408 00000100:00100000:2.0:1789175466.112924:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073408 00000100:00100000:2.0:1789175466.112945:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1789175466.112953:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073536:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175466.112985:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073536:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 33us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175466.112992:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1789175466.113006:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1789175466.113013:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073408:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175466.113036:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251073408:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175466.113042:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1789175466.113730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073024 00000100:00100000:0.0:1789175466.113738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073024 00000100:00100000:0.0:1789175466.113788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:0.0:1789175466.113797:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251073024:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175466.113834:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251073024:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 39us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175466.113841:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00080000:3.0:1789175466.115996:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789175466.116008:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175466.116013:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789175466.466076:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789175467.191795:0:10313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789175467.489614:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175468.515251:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175468.963485:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175468.963512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274173824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175468.963590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175468.963669:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173824 00000100:00100000:3.0:1789175468.963678:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173824 00000100:00100000:3.0:1789175468.963738:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789175468.963748:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274173824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175468.963785:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175468.963830:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274173824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175468.963837:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789175468.963858:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175468.963891:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbdf80 x1876086274173824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175468.963911:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274173824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175469.479525:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274174336:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479668:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789175469.479675:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274173952:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479731:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274174464:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479780:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274174080:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479821:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274174592:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479841:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479859:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175469.479864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274174208:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.479885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175469.479920:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174336 00000100:00100000:1.0:1789175469.479927:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174336 00000100:00100000:1.0:1789175469.479974:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174592 00000100:00100000:1.0:1789175469.479982:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174592 00000100:00100000:1.0:1789175469.480014:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789175469.480022:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274174336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480073:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274174336:12345-0@lo:400:kworker.0 Request processed in 50us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480080:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789175469.480097:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789175469.480103:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274174592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480133:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274174592:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480139:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789175469.480156:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274173952 00000100:00100000:1.0:1789175469.480159:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274173952 00000100:00100000:1.0:1789175469.480180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789175469.480186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274173952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480214:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274173952:12345-0@lo:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480219:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789175469.480244:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174464 00000100:00100000:1.0:1789175469.480248:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174464 00000100:00100000:1.0:1789175469.480272:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174080 00000100:00100000:1.0:1789175469.480275:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174080 00000100:00100000:1.0:1789175469.480285:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174208 00000100:00100000:1.0:1789175469.480288:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174208 00000100:00100000:1.0:1789175469.480303:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789175469.480309:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480334:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274174464:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480366:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789175469.480378:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175469.480384:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274174080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480412:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274174080:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480418:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175469.480428:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789175469.480434:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274174208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480455:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274174208:12345-0@lo:400:kworker.0 Request processed in 22us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175469.480461:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789175469.480485:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789175469.480490:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175469.480511:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274173952:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480524:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274174464:0@lo:400:kworker.0 00010000:00080000:1.0:1789175469.480536:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cf1880 x1876086274174336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175469.480547:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274174336:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274174208:0@lo:400:kworker.0 00000100:00100000:1.0:1789175469.480584:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274174080:0@lo:400:kworker.0 00010000:00080000:1.0:1789175469.480593:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cf1180 x1876086274174592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175469.480602:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274174592:0@lo:400:kworker.0 00000100:00100000:0.0:1789175469.480844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274174720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175469.480884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175469.480924:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174720 00000100:00100000:0.0:1789175469.480929:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174720 00000100:00100000:0.0:1789175469.480958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789175469.480965:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274174720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789175469.480994:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175469.481030:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274174720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175469.481036:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789175469.481064:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734375880 x1876086274174720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175469.481080:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274174720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789175469.541306:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175470.564691:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175471.238466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175471.238518:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175471.238545:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175471.238569:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175471.238593:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175471.238629:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074176 00000100:00100000:0.0:1789175471.238639:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074176 00000100:00100000:0.0:1789175471.238704:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074048 00000100:00100000:0.0:1789175471.238708:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074048 00000100:00100000:0.0:1789175471.238729:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1789175471.238740:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251074176:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175471.238841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073664 00000100:00100000:3.0:1789175471.238845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073664 00000100:00100000:3.0:1789175471.238874:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:3.0:1789175471.238881:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251073664:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175471.238971:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251073664:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 89us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175471.238979:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:0.0:1789175471.239302:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251074176:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 564us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175471.239311:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1789175471.239333:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1789175471.239363:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251074048:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175471.239390:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251074048:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 51us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175471.239397:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1789175471.239420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073920 00000100:00100000:0.0:1789175471.239424:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073920 00000100:00100000:0.0:1789175471.239454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251073792 00000100:00100000:0.0:1789175471.239457:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251073792 00000100:00100000:0.0:1789175471.239477:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1789175471.239483:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251073920:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175471.239510:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251073920:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175471.239516:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1789175471.239527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1789175471.239533:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251073792:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175471.239553:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251073792:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 21us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175471.239559:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00080000:0.0:1789175471.239578:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789175471.239583:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789175471.239585:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789175471.585490:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175472.611889:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175473.635268:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175474.081526:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175474.081578:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274174848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175474.081675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175474.081762:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174848 00000100:00100000:3.0:1789175474.081772:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174848 00000100:00100000:3.0:1789175474.081856:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789175474.081868:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274174848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175474.081910:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175474.081957:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274174848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175474.081964:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789175474.081988:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175474.082028:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbdf80 x1876086274174848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175474.082051:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274174848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175474.594074:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175474.596756:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274175232:0@lo:400:kworker.0 00000100:00100000:3.0:1789175474.596871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175474.596931:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175474.596937:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789175474.596962:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175474.598714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175232 00000100:00100000:1.0:1789175474.598734:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175232 00000100:00100000:1.0:1789175474.598804:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789175474.598815:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274175232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175474.598917:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274175232:12345-0@lo:400:kworker.0 Request processed in 103us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175474.598924:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789175474.598979:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274175232:0@lo:400:kworker.0 00000100:00100000:1.0:1789175474.599014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175104 00000100:00100000:1.0:1789175474.599019:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175104 00000100:00100000:1.0:1789175474.599045:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789175474.599051:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274175104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175474.599088:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274175104:12345-0@lo:400:kworker.0 Request processed in 37us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175474.599094:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789175474.599131:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274175104:0@lo:400:kworker.0 00000100:00100000:2.0:1789175474.602643:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274175360:0@lo:400:kworker.0 00000100:00100000:2.0:1789175474.604106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175474.604190:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274174976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175474.604271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175474.604361:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274174976 00000100:00100000:2.0:1789175474.604372:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274174976 00000100:00100000:2.0:1789175474.604458:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789175474.604472:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274174976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175474.605902:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274175488:0@lo:400:kworker.0 00000100:00100000:0.0:1789175474.605965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789175474.606058:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789175474.606065:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175474.606085:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175360 00000100:00100000:0.0:1789175474.606095:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175360 00000100:00100000:0.0:1789175474.606157:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175488 00000100:00100000:0.0:1789175474.606160:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175488 00000100:00100000:2.0:1789175474.606169:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274174976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1694us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175474.606183:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789175474.606309:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734376300 x1876086274174976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175474.606427:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274174976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175474.608992:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789175474.609021:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274175360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175474.609151:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274175360:12345-0@lo:400:kworker.0 Request processed in 143us (5060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175474.609197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789175474.609240:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274175488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175474.609372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274175488:12345-0@lo:400:kworker.0 Request processed in 147us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175474.609381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789175474.609550:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274175488:0@lo:400:kworker.0 00000100:00100000:3.0:1789175474.609773:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274175360:0@lo:400:kworker.0 00000100:00100000:0.0:1789175474.611626:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789175474.611679:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789175474.662166:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175475.681823:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175476.369680:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175476.376194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074432 00000100:00100000:0.0:1789175476.376214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074432 00000100:00100000:0.0:1789175476.378838:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1789175476.378859:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251074432:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1789175476.382847:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175476.384898:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175476.386327:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175476.386389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175476.386436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175476.386480:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074688 00000100:00100000:3.0:1789175476.386489:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074688 00000100:00100000:0.0:1789175476.390901:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074560 00000100:00100000:0.0:1789175476.390923:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074560 00000100:00100000:0.0:1789175476.391011:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:0.0:1789175476.391024:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074560:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175476.391231:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074560:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 209us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175476.391239:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00080000:0.0:1789175476.391268:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175476.391468:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251074432:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 12617us (21799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175476.391476:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:2.0:1789175476.395867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074304 00000100:00100000:2.0:1789175476.395884:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074304 00000100:00100000:2.0:1789175476.397653:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:2.0:1789175476.397692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251074304:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175476.397806:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251074304:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 136us (11485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175476.397814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:0.0:1789175476.398496:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074816 00000100:00100000:0.0:1789175476.398543:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074816 00000100:00100000:0.0:1789175476.398684:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:0.0:1789175476.399148:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074816:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:2.0:1789175476.399149:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175476.399255:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074816:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 122us (12818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175476.399279:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1789175476.399772:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1789175476.399782:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074688:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175476.399817:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251074688:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 37us (14929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175476.399823:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00080000:2.0:1789175476.400178:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789175476.706924:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175477.731613:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175478.754747:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175479.202851:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274175616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175479.202964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175479.207281:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175616 00000100:00100000:2.0:1789175479.207302:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175616 00000100:00080000:0.0:1789175479.207518:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175479.207530:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789175479.207548:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274175616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175479.207600:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175479.217090:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274175616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9533us (14122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175479.217115:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789175479.217403:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734374e00 x1876086274175616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175479.217575:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274175616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175479.714780:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175479.714809:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274175744:0@lo:400:kworker.0 00000100:00100000:0.0:1789175479.714819:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274176256:0@lo:400:kworker.0 00000100:00100000:0.0:1789175479.714891:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175479.714945:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175479.714951:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274176128:0@lo:400:kworker.0 00000100:00100000:0.0:1789175479.714978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175479.714986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175479.715003:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274175872:0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.715014:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175744 00000100:00100000:1.0:1789175479.715022:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175744 00000100:00100000:0.0:1789175479.715049:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175479.715065:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789175479.715067:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175479.715071:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274176000:0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.715074:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175479.715092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175479.715117:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176256 00000100:00100000:0.0:1789175479.715120:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176256 00000100:00100000:1.0:1789175479.715121:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274175744:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175479.715127:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789175479.715159:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789175479.715166:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274176256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.715168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274175744:0@lo:400:kworker.0 00000100:00100000:0.0:1789175479.715200:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274176256:12345-0@lo:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175479.715205:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789175479.715221:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176128 00000100:00100000:0.0:1789175479.715232:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176128 00000100:00100000:0.0:1789175479.715255:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274175872 00000100:00100000:1.0:1789175479.715256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176000 00000100:00100000:0.0:1789175479.715257:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274175872 00000100:00100000:1.0:1789175479.715258:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176000 00000100:00100000:0.0:1789175479.715270:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789175479.715275:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175479.715383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175479.715393:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274176384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175479.715421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175479.715587:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274176128:12345-0@lo:400:kworker.0 Request processed in 299us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175479.716991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789175479.717016:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.717092:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274175872:12345-0@lo:400:kworker.0 Request processed in 90us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175479.717099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789175479.717128:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789175479.717135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274176000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.717163:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274176000:12345-0@lo:400:kworker.0 Request processed in 30us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175479.717170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789175479.717309:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789175479.717315:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175479.717373:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274176128:0@lo:400:kworker.0 00010000:00080000:1.0:1789175479.717390:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e3cc000 x1876086274176256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175479.717401:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274176256:0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.717555:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274176000:0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.717569:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274175872:0@lo:400:kworker.0 00000100:00100000:1.0:1789175479.717600:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176384 00000100:00100000:1.0:1789175479.717606:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176384 00000100:00100000:1.0:1789175479.717716:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789175479.717725:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274176384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175479.717760:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175479.717801:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274176384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175479.717807:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789175479.717915:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d35f80 x1876086274176384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175479.717930:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274176384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175479.730089:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:3.0:1789175479.778547:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175480.802982:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175481.471427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175481.471759:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251074944 00000100:00100000:2.0:1789175481.471769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251074944 00000100:00100000:2.0:1789175481.471823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:2.0:1789175481.471834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251074944:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175481.471911:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251074944:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 78us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175481.471930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:0.0:1789175481.477140:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175481.477231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175481.477539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075200 00000100:00100000:2.0:1789175481.477560:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075200 00000100:00100000:2.0:1789175481.477648:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075072 00000100:00100000:2.0:1789175481.477652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075072 00000100:00100000:2.0:1789175481.477681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1789175481.477690:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251075200:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175481.477770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251075200:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175481.477778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1789175481.477793:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:2.0:1789175481.477800:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251075072:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175481.477823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251075072:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175481.477830:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1789175481.478132:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175481.478197:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00080000:0.0:1789175481.478577:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175481.478598:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075328 00000100:00100000:0.0:1789175481.478604:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075328 00000100:00100000:0.0:1789175481.478816:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075456 00000100:00100000:0.0:1789175481.478821:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075456 00000100:00100000:0.0:1789175481.478841:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175481.478849:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2352:x1876086251075328:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:0.0:1789175481.478872:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c166e5 00000100:00080000:0.0:1789175481.478881:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e734cd7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789175481.478923:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1789175481.479220:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175481.479223:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789175481.479246:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175481.479941:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+2:2352:x1876086251075328:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 1090us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175481.479951:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175481.479974:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175481.479984:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2352:x1876086251075456:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:0.0:1789175481.480002:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c166ec 00000100:00080000:0.0:1789175481.480010:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e73465b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789175481.480058:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789175481.480311:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+2:2352:x1876086251075456:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 329us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175481.480318:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:2.0:1789175481.480939:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175481.826157:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175482.849883:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175483.874198:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175484.322640:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274176512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175484.322716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175484.323214:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176512 00000100:00100000:2.0:1789175484.323224:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176512 00000100:00100000:2.0:1789175484.323286:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789175484.323295:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274176512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175484.323331:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175484.323423:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274176512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175484.323431:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789175484.324712:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789175484.327701:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e18f480 x1876086274176512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175484.327732:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274176512:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789175484.398478:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00000020:00000080:0.0:1789175484.398487:0:7644:0:(genops.c:885:class_export_put()) final put ffff97e734cd1000/15bde859-e823-4861-b8b2-68ba9f4f9050 00000020:00000080:3.0:1789175484.399915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734cd1000/15bde859-e823-4861-b8b2-68ba9f4f9050 for lustre-OST0001 00000020:00000080:3.0:1789175484.399988:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73465b000 for lustre-OST0001 00000001:02000400:3.0:1789175484.534929:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789175484.834328:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274176640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175484.834479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175484.834613:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176640 00000100:00100000:2.0:1789175484.834626:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176640 00000100:00100000:2.0:1789175484.834725:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789175484.834738:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274176640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175484.834792:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175484.836379:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274177024:0@lo:400:kworker.0 00000100:00100000:1.0:1789175484.836582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274177152:0@lo:400:kworker.0 00000100:00080000:3.0:1789175484.836703:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175484.836752:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274176896:0@lo:400:kworker.0 00000100:00100000:2.0:1789175484.841973:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274176640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7228us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175484.841993:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789175484.843888:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274176768:0@lo:400:kworker.0 00000100:00100000:2.0:1789175484.843985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175484.844065:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176768 00000100:00100000:2.0:1789175484.844076:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176768 00000100:00100000:2.0:1789175484.844132:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789175484.844144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274176768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175484.844214:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274176768:12345-0@lo:400:kworker.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175484.844223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789175484.844283:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274176768:0@lo:400:kworker.0 00000100:00100000:0.0:1789175484.845769:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175484.845853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177024 00000100:00100000:0.0:1789175484.845874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177024 00000100:00100000:0.0:1789175484.845948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789175484.845959:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274177024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175484.846023:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274177024:12345-0@lo:400:kworker.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175484.846031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789175484.846058:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175484.846093:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274177024:0@lo:400:kworker.0 00000100:00100000:1.0:1789175484.851276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789175484.851392:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e602d36300 x1876086274176640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175484.851429:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274176640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175484.853792:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177152 00000100:00100000:0.0:1789175484.853814:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177152 00000100:00100000:0.0:1789175484.854301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789175484.854315:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175484.854479:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274177152:12345-0@lo:400:kworker.0 Request processed in 167us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175484.854494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789175484.854649:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175484.854716:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274177152:0@lo:400:kworker.0 00000100:00100000:3.0:1789175484.858123:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175484.858713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274176896 00000100:00100000:0.0:1789175484.858728:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274176896 00000100:00100000:0.0:1789175484.858795:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789175484.858808:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274176896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175484.859711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274176896:12345-0@lo:400:kworker.0 Request processed in 901us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175484.859723:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789175484.860049:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274176896:0@lo:400:kworker.0 00000001:00100000:2.0:1789175484.893006:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00000020:00000080:2.0:1789175484.893020:0:6713:0:(genops.c:885:class_export_put()) final put ffff97e734cd1800/15bde859-e823-4861-b8b2-68ba9f4f9050 00000020:00000080:3.0:1789175484.893179:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734cd1800/15bde859-e823-4861-b8b2-68ba9f4f9050 for lustre-OST0000 00000020:00000080:3.0:1789175484.893252:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e734cd7000 for lustre-OST0000 00010000:00010000:2.0:1789175484.898165:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175485.924224:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175486.597698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175486.597747:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175486.597799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175486.597845:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075584 00000100:00100000:0.0:1789175486.597859:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075584 00000100:00100000:0.0:1789175486.597926:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:0.0:1789175486.597939:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251075584:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175486.597966:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075712 00000100:00100000:2.0:1789175486.597972:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075712 00000100:00100000:2.0:1789175486.598021:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075840 00000100:00100000:2.0:1789175486.598025:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075840 00000100:00100000:0.0:1789175486.598034:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251075584:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175486.598044:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:2.0:1789175486.598054:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1789175486.598064:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251075712:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:0.0:1789175486.598092:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175486.598113:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2355:x1876086251075712:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175486.598120:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1789175486.598136:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:2.0:1789175486.598144:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251075840:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175486.598185:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251075840:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175486.598192:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00010000:00010000:3.0:1789175486.951156:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175487.969862:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789175488.130971:0:11166:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff459594b0 20000000:00000080:3.0:1789175488.131004:0:11166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e734478800 uarg=0000000000000000 20000000:01000000:3.0:1789175488.131061:0:11166:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789175488.131068:0:11166:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789175488.131074:0:11166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789175488.132050:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789175488.132376:0:11166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789175488.143995:0:11166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789175488.144585:0:11166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144618:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144632:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144641:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144649:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144656:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144664:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144745:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144764:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 12 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175488.144783:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177280:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175488.144957:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.144967:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 18 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175488.144978:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177408:0@lo:104: 00000100:00100000:2.0:1789175488.145024:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175488.145080:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177408 00010000:00010000:2.0:1789175488.145085:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175488.145091:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177408 00010000:00010000:2.0:1789175488.145098:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175488.145109:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177536:0@lo:104: 00000100:00100000:2.0:1789175488.145137:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175488.148861:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.148888:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 18 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175488.148935:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177664:0@lo:104: 00000100:00100000:2.0:1789175488.149014:0:11166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175488.149978:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177536 00000100:00100000:1.0:1789175488.149991:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177536 00000100:00100000:1.0:1789175488.150063:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789175488.150075:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11166:x1876086274177408:12345-0@lo:104: 00010000:00010000:1.0:1789175488.150095:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.150185:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789175488.150191:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11166:x1876086274177408:12345-0@lo:104: Request processed in 119us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175488.150200:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789175488.150220:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789175488.150226:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11166:x1876086274177536:12345-0@lo:104: 00010000:00010000:1.0:1789175488.150235:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.150266:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789175488.150271:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11166:x1876086274177536:12345-0@lo:104: Request processed in 45us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175488.150290:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789175488.150426:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789175488.150436:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150446:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175488.150450:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150461:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175488.150470:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175488.150489:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175488.150546:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150554:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175488.150578:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150587:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c166bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175488.150600:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274177792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175488.150604:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175488.150609:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150615:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175488.150618:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150625:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175488.150632:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175488.150638:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175488.150651:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150657:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175488.150682:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150690:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705669400/0x1112cdeac4c166ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166b4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.150701:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175488.150702:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175488.150704:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175488.150712:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175488.150819:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274177920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175488.150877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175488.150878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175488.151059:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.151080:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 12 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175488.151094:0:11166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274178048:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175488.151148:0:11166:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7181e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789175488.151176:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177408:0@lo:104: 00000100:00100000:2.0:1789175488.151303:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177536:0@lo:104: 00000100:00100000:0.0:1789175488.151509:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177664 00000100:00100000:0.0:1789175488.151517:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177664 00000100:00100000:0.0:1789175488.151557:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789175488.151575:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11166:x1876086274177664:12345-0@lo:104: 00010000:00010000:0.0:1789175488.151587:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175488.151638:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789175488.151645:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11166:x1876086274177664:12345-0@lo:104: Request processed in 71us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175488.151651:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789175488.151808:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175488.151815:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.151822:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175488.151825:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.151832:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175488.151839:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175488.151844:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175488.151870:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.151877:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175488.151898:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.151905:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1e00/0x1112cdeac4c1669f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c166a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.151922:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175488.151925:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175488.151926:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175488.151952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177792 00000100:00100000:3.0:1789175488.151956:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177792 00010000:00010000:3.0:1789175488.151980:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 19 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175488.152003:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274177920 00000100:00100000:3.0:1789175488.152006:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274177920 00010000:00010000:3.0:1789175488.152017:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 20 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175488.152035:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175488.152041:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707447450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3307:x1876086274177792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175488.152054:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175488.152059:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 20 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152069:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 20 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152083:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c166c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c166bb expref: 20 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152109:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175488.152140:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707447450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274177792:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175488.152146:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175488.152204:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789175488.152210:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3304:x1876086274177920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175488.152216:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175488.152220:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152228:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152238:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c166b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c166ad expref: 18 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175488.152246:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175488.152266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3304:x1876086274177920:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175488.152272:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789175488.152304:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274178176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175488.152368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175488.152389:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178176 00000100:00100000:1.0:1789175488.152395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178176 00000100:00100000:3.0:1789175488.152419:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274177792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175488.152419:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175488.152452:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789175488.152462:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3305:x1876086274178176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175488.152472:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789175488.152473:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274177920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175488.152479:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175488.152519:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177280:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175488.152537:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274177664:0@lo:104: 00010000:00010000:1.0:1789175488.152555:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.152568:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654b000/0x1112cdeac4c166a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1669f expref: 17 pid: 5832 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.152579:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175488.152674:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3305:x1876086274178176:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175488.152682:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789175488.153313:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274178176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175488.157302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175488.157476:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175488.160510:0:11166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876086274178048:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175488.160578:0:11166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175488.168202:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251075968 00000100:00100000:0.0:1789175488.168224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251075968 00010000:00010000:0.0:1789175488.168296:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 13 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175488.168385:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076096 00000100:00100000:0.0:1789175488.168390:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076096 00010000:00010000:0.0:1789175488.168406:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 14 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175488.168432:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:0.0:1789175488.168443:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+14:2354:x1876086251075968:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175488.168462:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175488.168470:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 14 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175488.168478:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00010000:00010000:0.0:1789175488.168490:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 14 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175488.168496:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+14:2354:x1876086251076096:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175488.168512:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175488.168522:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1a00/0x1112cdeac4c166d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b0c expref: 14 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168538:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 14 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168561:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 13 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168645:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e705668c00/0x1112cdeac4c16698 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ad4 expref: 13 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175488.168658:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175488.168662:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168675:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168697:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168706:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168716:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168725:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168731:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175488.168737:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168747:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175488.168761:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:2354:x1876086251075968:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 317us (11471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175488.168771:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:1.0:1789175488.168775:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175488.168803:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175488.168828:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2354:x1876086251076096:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 340us (11353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175488.168838:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00010000:00010000:2.0:1789175488.169003:0:11166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.169014:0:11166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175488.169021:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0a00/0x1112cdeac4c166f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175488.998814:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175489.407469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175489.407575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076224 00000100:00100000:0.0:1789175489.407586:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076224 00000100:00100000:0.0:1789175489.407655:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:0.0:1789175489.407666:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:5596:x1876086251076224:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175489.407683:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175489.407705:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.407734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.407747:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.407757:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668a00, rc 0) 00000100:00100000:0.0:1789175489.407822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076224:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175489.407830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:2.0:1789175489.409392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175489.409755:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076352 00000100:00100000:0.0:1789175489.409763:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076352 00000100:00100000:0.0:1789175489.409821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:0.0:1789175489.409832:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076352:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.410109:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076352:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 279us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175489.410117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:2.0:1789175489.412283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175489.412392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076480 00000100:00100000:1.0:1789175489.412400:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076480 00000100:00100000:1.0:1789175489.412515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:1.0:1789175489.412527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076480:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175489.412757:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076480:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 232us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175489.412765:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:2.0:1789175489.430938:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175489.431274:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076608 00000100:00100000:3.0:1789175489.431285:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076608 00000100:00100000:3.0:1789175489.431366:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:3.0:1789175489.431381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251076608:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175489.431399:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175489.431419:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b3d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.431459:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.431472:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.431481:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9e00, rc 0) 00000100:00100000:3.0:1789175489.431543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251076608:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 169us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.431550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:3.0:1789175489.436100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175489.442040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076736 00000100:00100000:2.0:1789175489.442056:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076736 00000100:00100000:2.0:1789175489.442135:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:2.0:1789175489.442150:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251076736:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.442489:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251076736:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 343us (6398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.442513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:3.0:1789175489.446065:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274178304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175489.446141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175489.446230:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178304 00000100:00100000:3.0:1789175489.446250:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178304 00000100:00100000:3.0:1789175489.446322:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789175489.446334:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274178304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175489.446394:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175489.446442:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274178304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.446449:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789175489.446474:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175489.446506:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e7077bb100 x1876086274178304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175489.446524:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274178304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175489.450269:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175489.450558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076864 00000100:00100000:1.0:1789175489.450571:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076864 00000100:00100000:1.0:1789175489.450618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:1.0:1789175489.450629:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251076864:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175489.450837:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251076864:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 208us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175489.450845:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 233 10000000:01000000:3.0:1789175489.573524:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789175489.573534:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7264f7000 from 7 10000000:01000000:3.0:1789175489.573540:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175489.573586:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.573597:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.573608:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175489.573636:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.573708:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175489.573767:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97000 going to sleep for 11 seconds 00000100:00100000:3.0:1789175489.573790:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178432 00000100:00100000:3.0:1789175489.573798:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178432 00000100:00100000:3.0:1789175489.573847:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789175489.573864:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274178432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175489.573878:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175489.573891:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16708 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.573916:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.573927:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.573936:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8e00, rc 0) 00000100:00100000:3.0:1789175489.573973:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.573980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789175489.574028:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175489.574042:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.574050:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175489.574113:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.574139:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175489.574155:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97000 going to sleep for 11 seconds 00000100:00100000:3.0:1789175489.574167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178560 00000100:00100000:3.0:1789175489.574170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178560 00000100:00100000:3.0:1789175489.574190:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789175489.574203:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.574724:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.574731:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789175489.574762:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.574790:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.574826:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175489.574840:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc97000 going to sleep for 11 seconds 00000100:00100000:3.0:1789175489.574853:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178688 00000100:00100000:3.0:1789175489.574857:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178688 00000100:00100000:3.0:1789175489.574878:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789175489.574884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.575018:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.575023:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789175489.575051:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789175489.580135:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789175489.582444:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789175489.582482:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789175489.582493:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.582506:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175489.582517:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175489.582519:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73c3b2800 from 7 10000000:01000000:0.0:1789175489.582522:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175489.582561:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.582569:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.582581:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175489.582606:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.582677:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.582721:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1789175489.583884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178816 00000100:00100000:3.0:1789175489.583896:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178816 00000100:00100000:3.0:1789175489.583949:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789175489.583960:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274178816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175489.583975:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175489.583991:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16716 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.584026:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.584036:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.584043:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9800, rc 0) 00000100:00100000:3.0:1789175489.584101:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274178816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.584108:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789175489.584128:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175489.584144:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.584160:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175489.584377:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.584410:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.584440:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1789175489.584491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274178944 00000100:00100000:3.0:1789175489.584495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274178944 00000100:00100000:3.0:1789175489.584544:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789175489.584550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274178944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175489.584790:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274178944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.584797:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789175489.584809:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274178944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.584858:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.584892:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.584908:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1789175489.585377:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179072 00000100:00100000:2.0:1789175489.585383:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179072 00000100:00100000:2.0:1789175489.585422:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789175489.585430:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274179072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.585579:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274179072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.585587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789175489.585602:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789175489.587002:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789175489.587526:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789175489.587562:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175489.587574:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175489.587588:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175489.587598:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789175489.587601:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7201da000 from 7 10000000:01000000:2.0:1789175489.587604:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175489.587652:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175489.587660:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175489.587669:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175489.587692:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.587751:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175489.587795:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175489.587887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179200 00000100:00100000:0.0:1789175489.587896:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179200 00000100:00100000:0.0:1789175489.587949:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789175489.587959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274179200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175489.587973:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175489.587988:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16724 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.588189:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.588202:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175489.588223:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668e00, rc 0) 00000100:00100000:0.0:1789175489.588543:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274179200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 583us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175489.588551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789175489.589437:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175489.589462:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175489.589474:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175489.589543:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.589576:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175489.589612:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175489.589618:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179328 00000100:00100000:0.0:1789175489.589624:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179328 00000100:00100000:0.0:1789175489.589665:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789175489.589673:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274179328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175489.589959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274179328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175489.589966:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789175489.590186:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.590224:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.590273:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175489.590292:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:2.0:1789175489.590315:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179456 00000100:00100000:2.0:1789175489.590325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179456 00000100:00100000:2.0:1789175489.590372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789175489.590379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274179456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175489.590535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274179456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.590542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789175489.590574:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274179456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789175489.601477:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789175489.601566:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789175489.601591:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175489.601604:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175489.601616:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175489.953702:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274179584:0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.953790:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.953865:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175489.953872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274179968:0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.953903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.953943:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274179712:0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.953970:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.953993:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175489.953999:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274179840:0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.954022:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175489.954140:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179584 00000100:00100000:0.0:1789175489.954151:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179584 00000100:00100000:0.0:1789175489.954207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179712 00000100:00100000:0.0:1789175489.954211:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179712 00000100:00100000:2.0:1789175489.954470:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179840 00000100:00100000:2.0:1789175489.954475:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179840 00000100:00100000:2.0:1789175489.954502:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789175489.954512:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274179584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175489.954574:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274179584:12345-0@lo:400:kworker.0 Request processed in 63us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.954583:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789175489.954601:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789175489.954608:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274179840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175489.954641:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274179840:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.954647:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789175489.954704:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274179840:0@lo:400:kworker.0 00000100:00100000:2.0:1789175489.954750:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274179584:0@lo:400:kworker.0 00000100:00080000:2.0:1789175489.954778:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175489.954801:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274179968 00000100:00100000:2.0:1789175489.954805:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274179968 00000100:00100000:2.0:1789175489.954841:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789175489.954858:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274179968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175489.954897:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274179968:12345-0@lo:400:kworker.0 Request processed in 41us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175489.954903:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789175489.954920:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789175489.955090:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e18e680 x1876086274179968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175489.955103:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274179968:0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.955206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789175489.955214:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175489.955255:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274179712:12345-0@lo:400:kworker.0 Request processed in 43us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175489.955261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789175489.955287:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274179712:0@lo:400:kworker.0 00000100:00100000:2.0:1789175489.958198:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175489.958219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274180096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175489.958291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175489.958756:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180096 00000100:00100000:3.0:1789175489.958772:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180096 00000100:00100000:3.0:1789175489.959171:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789175489.959182:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274180096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175489.959224:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175489.959304:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274180096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175489.959311:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789175489.959529:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737ca7b80 x1876086274180096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175489.959549:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274180096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789175490.024053:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175491.045681:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175491.714567:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175491.714622:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175491.714807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175491.714838:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251076992 00000100:00100000:2.0:1789175491.714847:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251076992 00000100:00100000:2.0:1789175491.714899:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:2.0:1789175491.714910:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251076992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175491.714978:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251076992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 69us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175491.714985:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:2.0:1789175491.715019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077120 00000100:00100000:2.0:1789175491.715033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077120 00000100:00100000:2.0:1789175491.715072:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077248 00000100:00100000:2.0:1789175491.715074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077248 00000100:00100000:2.0:1789175491.715093:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1789175491.715099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251077120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175491.715130:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251077120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175491.715136:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1789175491.715146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:2.0:1789175491.715152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251077248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175491.715174:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251077248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175491.715180:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00080000:3.0:1789175491.715514:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789175492.070736:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789175492.182947:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789175493.090061:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175494.114571:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175494.565977:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274180224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175494.566048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175494.566561:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180224 00000100:00100000:1.0:1789175494.566570:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180224 00000100:00100000:1.0:1789175494.566627:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789175494.566636:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274180224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175494.566678:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175494.566727:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274180224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175494.566734:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789175494.566767:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789175494.566797:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e18d180 x1876086274180224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175494.566816:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274180224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175495.073824:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274180608:0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.073906:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175495.073967:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789175495.073973:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274180480:0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.073994:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175495.074020:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274180992:0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.074042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175495.074072:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180992 00000100:00100000:1.0:1789175495.074080:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180992 00000100:00100000:1.0:1789175495.074156:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789175495.074166:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274180992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.074337:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274180992:12345-0@lo:400:kworker.0 Request processed in 171us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175495.074365:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789175495.074385:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175495.074397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274180736:0@lo:400:kworker.0 00000100:00100000:0.0:1789175495.074488:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274180352:0@lo:400:kworker.0 00000100:00100000:0.0:1789175495.074520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175495.074543:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274180864:0@lo:400:kworker.0 00000100:00100000:0.0:1789175495.074562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789175495.074611:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cf1f80 x1876086274180992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175495.074623:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274180992:0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.074687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175495.074930:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180608 00000100:00100000:3.0:1789175495.074936:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180608 00000100:00100000:3.0:1789175495.074973:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180480 00000100:00100000:3.0:1789175495.074976:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180480 00000100:00100000:3.0:1789175495.074989:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180864 00000100:00100000:3.0:1789175495.074992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180864 00000100:00100000:3.0:1789175495.075007:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789175495.075013:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274180608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175495.075055:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274180608:12345-0@lo:400:kworker.0 Request processed in 42us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175495.075061:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789175495.075075:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789175495.075080:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274180480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175495.075263:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274180480:12345-0@lo:400:kworker.0 Request processed in 182us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175495.075271:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789175495.075283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789175495.075290:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274180864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175495.075359:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274180864:12345-0@lo:400:kworker.0 Request processed in 50us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175495.075366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789175495.075862:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180736 00000100:00100000:0.0:1789175495.075868:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180736 00000100:00100000:0.0:1789175495.075903:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789175495.075910:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274180736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175495.075950:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274180736:12345-0@lo:400:kworker.0 Request processed in 40us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175495.075956:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789175495.075992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274180864:0@lo:400:kworker.0 00000100:00080000:1.0:1789175495.076143:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789175495.076168:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cf0000 x1876086274180736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175495.076179:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274180736:0@lo:400:kworker.0 00000100:00100000:2.0:1789175495.076221:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274180352 00000100:00100000:2.0:1789175495.076227:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274180352 00000100:00100000:2.0:1789175495.076256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789175495.076264:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274180352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175495.076303:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274180352:12345-0@lo:400:kworker.0 Request processed in 41us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175495.076309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789175495.076331:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175495.076355:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274181120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175495.076385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175495.076439:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274180480:0@lo:400:kworker.0 00000100:00100000:2.0:1789175495.076463:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274180608:0@lo:400:kworker.0 00000100:00100000:1.0:1789175495.081623:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181120 00000100:00100000:1.0:1789175495.081638:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181120 00000100:00100000:1.0:1789175495.081699:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789175495.081709:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274181120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175495.081779:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175495.081868:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274181120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (5481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175495.081875:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789175495.082072:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734374a80 x1876086274181120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175495.082104:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274181120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175495.085774:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274180352:0@lo:400:kworker.0 00010000:00010000:3.0:1789175495.137717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175496.162886:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789175496.527213:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:11:35 (1789175495) === 00000100:00100000:2.0:1789175496.835563:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175496.835625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175496.835678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175496.835837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077376 00000100:00100000:0.0:1789175496.835849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077376 00000100:00100000:0.0:1789175496.835906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:0.0:1789175496.835918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251077376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175496.835995:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251077376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175496.836002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:1.0:1789175496.840461:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077632 00000100:00100000:1.0:1789175496.840484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077632 00000100:00100000:1.0:1789175496.840674:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077504 00000100:00100000:1.0:1789175496.840678:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077504 00000100:00100000:1.0:1789175496.840715:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1789175496.840724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251077632:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175496.840837:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251077632:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 113us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.840845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1789175496.840874:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:1.0:1789175496.840882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251077504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175496.840908:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251077504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.840914:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00080000:0.0:1789175496.841869:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175496.894799:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175496.894848:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175496.895045:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077760 00000100:00100000:1.0:1789175496.895056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077760 00000100:00100000:1.0:1789175496.895124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1789175496.895134:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251077760:12345-192.168.201.18@tcp:41:mkdir.0 00000004:00000024:1.0:1789175496.895194:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789175496.897442:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251077888 00000100:00100000:2.0:1789175496.897460:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251077888 00000100:00100000:2.0:1789175496.897534:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1789175496.897545:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9698:x1876086251077888:12345-192.168.201.18@tcp:700:mkdir.0 00000100:00100000:2.0:1789175496.897650:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9698:x1876086251077888:12345-192.168.201.18@tcp:700:mkdir.0 Request processed in 107us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175496.897657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1789175496.901062:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251077760:12345-192.168.201.18@tcp:41:mkdir.0 Request processed in 5918us (6265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.901077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1789175496.901938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175496.904656:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251078144 00000100:00100000:1.0:1789175496.904672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251078144 00000100:00100000:1.0:1789175496.906583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1789175496.906607:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:9698:x1876086251078144:12345-192.168.201.18@tcp:36:mkdir.0 00010000:00010000:1.0:1789175496.906675:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175496.907042:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2abf expref: 6 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.907067:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175496.907096:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175496.913940:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.913964:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.913978:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.913991:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.914015:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.914022:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175496.916404:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789175496.916426:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916439:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916447:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916453:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175496.916459:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916467:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916488:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55200) 00010000:00010000:1.0:1789175496.916492:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175496.916497:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.916504:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16732 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175496.916542:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000991ebad8 reply state 00000000926cafc8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175496.916551:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789175496.916717:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9698:x1876086251078144:12345-192.168.201.18@tcp:36:mkdir.0 Request processed in 10115us (14775us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789175496.916728:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:2.0:1789175496.920291:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920312:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920320:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920327:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175496.920331:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920393:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920411:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e721b55300) 00010000:00010000:2.0:1789175496.920414:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175496.920419:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.920426:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16739 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175496.946163:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175496.946459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251078272 00000100:00100000:1.0:1789175496.946470:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251078272 00000100:00100000:1.0:1789175496.946526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1789175496.946536:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:9699:x1876086251078272:12345-192.168.201.18@tcp:101:chmod.0 00010000:00010000:1.0:1789175496.946558:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175496.946581:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b44 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946648:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946662:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946675:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175496.946711:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789175496.946714:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175496.946768:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946814:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b44 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946832:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b44 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.946842:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55200) 00010000:00010000:1.0:1789175496.946845:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175496.946849:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:1.0:1789175496.946915:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9699:x1876086251078272:12345-192.168.201.18@tcp:101:chmod.0 Request processed in 380us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.946922:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1789175496.949775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175496.949948:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251078528 00000100:00100000:2.0:1789175496.949961:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251078528 00000100:00100000:2.0:1789175496.950026:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175496.950037:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9699:x1876086251078528:12345-192.168.201.18@tcp:36:chmod.0 00010000:00010000:2.0:1789175496.950121:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175496.950150:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b44 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.950171:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55200) 00010000:00010000:2.0:1789175496.950196:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175496.950223:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.950238:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175496.950248:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175496.950625:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000362f1f54 reply state 0000000013a8d3fc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175496.950636:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789175496.950644:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789175496.950738:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:9699:x1876086251078528:12345-192.168.201.18@tcp:36:chmod.0 Request processed in 702us (977us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789175496.951302:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00010000:00010000:0.0:1789175496.952976:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.952990:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.952997:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.953003:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175496.953008:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.953016:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.953049:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:0.0:1789175496.953052:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789175496.953056:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175496.953063:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c1674e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175496.991886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175496.992188:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251078656 00000100:00100000:1.0:1789175496.992198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251078656 00000100:00100000:1.0:1789175496.992272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1789175496.992282:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9700:x1876086251078656:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:1.0:1789175496.992317:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175496.992388:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992475:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992491:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992505:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175496.992564:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789175496.992567:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175496.992608:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992636:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b4b expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992656:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b4b expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.992665:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175496.992668:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175496.992672:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175496.992737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:9700:x1876086251078656:12345-192.168.201.18@tcp:101:chown.0 Request processed in 456us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.992745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175496.997786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175496.997867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251078784 00000100:00100000:1.0:1789175496.997878:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251078784 00000100:00100000:1.0:1789175496.997942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1789175496.997954:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:9700:x1876086251078784:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:1.0:1789175496.997976:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175496.997996:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b52 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998069:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998103:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998117:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998134:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998141:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998148:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998266:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998274:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998291:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175496.998329:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789175496.998332:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175496.998388:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998399:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998414:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998421:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998427:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175496.998431:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998439:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998450:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175496.998453:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175496.998457:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998463:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c1676a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998475:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998480:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998485:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998489:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175496.998497:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998503:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998510:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e721b55b00) 00010000:00010000:1.0:1789175496.998513:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175496.998515:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998521:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998551:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b52 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998562:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b52 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175496.998570:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175496.998572:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175496.998575:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b400, rc 0) 00000100:00100000:1.0:1789175496.998683:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:9700:x1876086251078784:12345-192.168.201.18@tcp:101:chown.0 Request processed in 732us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175496.998691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1789175497.012917:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.013019:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079040 00000100:00100000:1.0:1789175497.013030:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079040 00000100:00100000:1.0:1789175497.013093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1789175497.013104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:9700:x1876086251079040:12345-192.168.201.18@tcp:36:chown.0 00010000:00010000:1.0:1789175497.013187:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175497.013214:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b52 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.013234:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175497.013262:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175497.013503:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.013517:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.013528:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175497.086501:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1789175497.088746:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfeee8ea reply state 00000000efe1be6b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175497.088776:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789175497.088796:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1789175497.088927:0:5838:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789175497.088949:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9700:x1876086251079040:12345-192.168.201.18@tcp:36:chown.0 Request processed in 75842us (76037us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789175497.088959:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00010000:00010000:0.0:1789175497.089790:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089804:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089811:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089818:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.089823:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089831:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089850:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e721b55b00) 00010000:00010000:0.0:1789175497.089853:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789175497.089864:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.089872:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c1677f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175497.124951:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.125034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079168 00000100:00100000:1.0:1789175497.125042:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079168 00000100:00100000:1.0:1789175497.125113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1789175497.125121:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:9701:x1876086251079168:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:1.0:1789175497.125141:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175497.125157:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789175497.131507:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6291us 00010000:00010000:0.0:1789175497.137279:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.137313:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.137326:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.137361:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.137368:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.137375:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138715:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138732:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138743:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175497.138773:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175497.138777:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175497.138818:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138841:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138848:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138854:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138860:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.138864:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138872:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138886:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175497.138889:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.138893:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138900:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1678d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138910:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138916:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138921:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138931:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.138934:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138939:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138946:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e7102ecb00) 00010000:00010000:0.0:1789175497.138948:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.138951:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138956:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16794 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.138994:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b400/0x1112cdeac4c16786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b59 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.139007:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b59 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.139013:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175497.139015:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789175497.139018:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669e00, rc 0) 00000100:00100000:0.0:1789175497.139085:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9701:x1876086251079168:12345-192.168.201.18@tcp:101:touch.500 Request processed in 13963us (14140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175497.139094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1789175497.143984:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.144115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079424 00000100:00100000:0.0:1789175497.144139:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079424 00000100:00100000:0.0:1789175497.144246:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:0.0:1789175497.144259:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:9701:x1876086251079424:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:0.0:1789175497.144283:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175497.144311:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c167a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b60 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144636:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144653:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144666:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144681:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144701:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.144708:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175497.145455:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789175497.145712:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668400/0x1112cdeac4c167b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145726:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668400/0x1112cdeac4c167b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145746:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668400/0x1112cdeac4c167b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145786:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145793:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145801:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145807:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.145812:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145820:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145833:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175497.145836:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.145840:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145847:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175497.145862:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ead4744f reply state 0000000084e2fff9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175497.145871:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789175497.145915:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c167a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b60 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145930:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668400/0x1112cdeac4c167b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b60 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.145938:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:0.0:1789175497.145940:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175497.145943:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668400, rc 0) 00000100:00100000:0.0:1789175497.146009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+10:9701:x1876086251079424:12345-192.168.201.18@tcp:101:touch.500 Request processed in 1753us (2035us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789175497.146018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00010000:00010000:2.0:1789175497.150210:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150229:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150237:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150245:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175497.150251:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150259:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150277:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff97e7102ec200) 00010000:00010000:2.0:1789175497.150280:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175497.150310:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.150317:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c167b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175497.150920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175497.150983:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079680 00000100:00100000:2.0:1789175497.150994:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079680 00000100:00100000:2.0:1789175497.151087:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175497.151099:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+9:9701:x1876086251079680:12345-192.168.201.18@tcp:36:touch.500 00010000:00010000:2.0:1789175497.151168:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175497.151200:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668400/0x1112cdeac4c167b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b60 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.151214:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:2.0:1789175497.151223:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175497.151280:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.151311:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.151324:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175497.151535:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e64e7ee reply state 000000002744d311 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175497.151546:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175497.151699:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+10:9701:x1876086251079680:12345-192.168.201.18@tcp:36:touch.500 Request processed in 602us (783us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789175497.151722:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00010000:00010000:1.0:1789175497.155590:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155613:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155646:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155652:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175497.155658:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155665:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155698:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:1.0:1789175497.155702:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175497.155708:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.155715:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c167c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175497.155853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.155917:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079808 00000100:00100000:1.0:1789175497.155929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079808 00000100:00100000:1.0:1789175497.156020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1789175497.156030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:9701:x1876086251079808:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:1.0:1789175497.156053:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175497.156073:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c167cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b67 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.156138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c167cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b67 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.156165:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c167cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b67 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.156196:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175497.156199:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175497.156201:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a400, rc 0) 00000100:00100000:1.0:1789175497.156285:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:9701:x1876086251079808:12345-192.168.201.18@tcp:101:touch.500 Request processed in 255us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175497.156292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1789175497.164367:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.164459:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251079936 00000100:00100000:0.0:1789175497.164472:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251079936 00000100:00100000:0.0:1789175497.164532:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1789175497.164543:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73bad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251079936:12345-192.168.201.18@tcp:8:touch.500 00010000:00080000:0.0:1789175497.164593:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:0.0:1789175497.164634:0:6686:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c167d3 00002000:00100000:0.0:1789175497.164650:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b56eceb-e538-4909-8f73-c533ee4baa44/ffff97e734025800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175497.164677:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175497.165202:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789175497.165248:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e734021000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175497.165333:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73bad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251079936:12345-192.168.201.18@tcp:8:touch.500 Request processed in 790us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175497.165378:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1789175497.170233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175497.170769:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251080064 00000100:00100000:2.0:1789175497.170787:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251080064 00000100:00100000:2.0:1789175497.170898:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175497.170916:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:0:x1876086251080064:12345-192.168.201.18@tcp:2:touch.500 00000100:00080000:1.0:1789175497.171484:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789175497.190198:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175497.229282:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:0:x1876086251080064:12345-192.168.201.18@tcp:2:touch.500 Request processed in 58356us (59061us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789175497.229310:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000001:00100000:2.0:1789175497.229383:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000001:00080000:2.0:1789175497.229402:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789175497.233026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.233219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251080320 00000100:00100000:1.0:1789175497.233234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251080320 00000100:00100000:1.0:1789175497.233316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1789175497.233329:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+10:9701:x1876086251080320:12345-192.168.201.18@tcp:35:touch.500 00000100:00100000:1.0:1789175497.234065:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+11:9701:x1876086251080320:12345-192.168.201.18@tcp:35:touch.500 Request processed in 735us (1050us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789175497.234074:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1789175497.249602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.249837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251080448 00000100:00100000:0.0:1789175497.249851:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251080448 00000100:00100000:0.0:1789175497.249932:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1789175497.249948:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+11:9702:x1876086251080448:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1789175497.249984:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175497.250012:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c167da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b6e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250128:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250149:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250163:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175497.250220:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175497.250225:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175497.250278:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250443:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c167da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b6e expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250471:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b6e expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.250481:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175497.250484:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175497.250509:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669c00, rc 0) 00000100:00100000:0.0:1789175497.251183:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+12:9702:x1876086251080448:12345-192.168.201.18@tcp:101:rm.0 Request processed in 1223us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175497.251194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1789175497.257019:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.257130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251080704 00000100:00100000:0.0:1789175497.257142:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251080704 00000100:00100000:0.0:1789175497.257252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:0.0:1789175497.257266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+12:9702:x1876086251080704:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1789175497.257305:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175497.257334:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c167e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b75 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175497.257538:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789175497.257969:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c167e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b75 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.257988:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175497.257992:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175497.257999:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c167e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b75 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.258019:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175497.258091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:9702:x1876086251080704:12345-192.168.201.18@tcp:101:rm.0 Request processed in 828us (1087us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789175497.258101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:1.0:1789175497.266635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175497.266897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251080832 00000100:00100000:3.0:1789175497.266910:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251080832 00000100:00100000:3.0:1789175497.266995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1789175497.267008:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:9702:x1876086251080832:12345-192.168.201.18@tcp:37:rm.0 00000100:00100000:0.0:1789175497.278205:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:9702:x1876086251080832:12345-192.168.201.18@tcp:37:rm.0 Request processed in 11181us (11567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175497.278244:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1789175497.284080:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.284496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251081088 00000100:00100000:1.0:1789175497.284511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251081088 00000100:00100000:1.0:1789175497.284607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1789175497.284622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708383850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:9702:x1876086251081088:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:1.0:1789175497.284994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708383850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:9702:x1876086251081088:12345-192.168.201.18@tcp:35:rm.0 Request processed in 375us (934us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789175497.285004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1789175497.291790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175497.291940:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251081344 00000100:00100000:2.0:1789175497.291955:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251081344 00000100:00100000:2.0:1789175497.292049:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:2.0:1789175497.292063:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+14:9702:x1876086251081344:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:2.0:1789175497.292116:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175497.292156:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c167f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b7c expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.292593:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c167fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.292615:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c167fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.292632:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c167fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175497.292813:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789175497.293054:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c167f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b7c expref: 17 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.293081:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c167fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b7c expref: 16 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.293092:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175497.293215:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175497.293221:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1c00, rc 0) 00000100:00100000:2.0:1789175497.294900:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251081344:12345-192.168.201.18@tcp:101:rm.0 Request processed in 2822us (3256us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789175497.294919:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:2.0:1789175497.301032:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.301201:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251081472 00000100:00100000:1.0:1789175497.301216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251081472 00000100:00100000:1.0:1789175497.301373:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1789175497.301387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251081472:12345-192.168.201.18@tcp:41:rm.0 00000004:00000024:1.0:1789175497.301484:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789175497.301817:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251081472:12345-192.168.201.18@tcp:41:rm.0 Request processed in 432us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175497.301828:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1789175497.304558:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.305282:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251081600 00000100:00100000:0.0:1789175497.305309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251081600 00000100:00100000:0.0:1789175497.305456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1789175497.305473:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251081600:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1789175497.305509:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175497.305551:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1680b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b83 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305849:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305867:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305887:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305895:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.305903:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306049:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306082:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306090:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175497.306204:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789175497.306210:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175497.306236:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306260:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306267:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306274:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306281:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.306297:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306306:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306321:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175497.306325:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.306370:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306379:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306396:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306404:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306410:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306415:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.306419:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306425:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306434:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff97e7102ece00) 00010000:00010000:0.0:1789175497.306436:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.306440:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306446:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306489:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1680b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b83 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306520:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b83 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.306712:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:0.0:1789175497.306716:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175497.306719:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669200, rc 0) 00000100:00100000:0.0:1789175497.306822:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+17:9702:x1876086251081600:12345-192.168.201.18@tcp:101:rm.0 Request processed in 1352us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175497.306833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1789175497.312021:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175497.312204:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251081856 00000100:00100000:3.0:1789175497.312219:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251081856 00000100:00100000:3.0:1789175497.312300:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1789175497.312312:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+17:9702:x1876086251081856:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:3.0:1789175497.312428:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789175497.312475:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669200/0x1112cdeac4c16820 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b83 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312503:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c167cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b67 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312517:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:3.0:1789175497.312554:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c167e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b6e expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312563:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:3.0:1789175497.312567:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175497.312596:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312613:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312626:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312812:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312823:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.312855:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.313006:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.313015:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175497.313023:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789175497.315507:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789175497.315726:0:8054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 282274383666ns, next at 283274377378ns, rc = 0 00010000:00010000:2.0:1789175497.315836:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315859:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315871:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315882:0:8054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315902:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315909:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315939:0:8054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175497.315969:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315975:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315982:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.315988:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175497.315993:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316002:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316017:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e7051dba00) 00010000:00010000:2.0:1789175497.316021:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789175497.316027:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316034:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16835 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316070:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316083:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316090:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316105:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175497.316108:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316115:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316123:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175497.316126:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175497.316129:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175497.316135:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16827 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175497.316147:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007796c021 reply state 00000000bd4577a2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175497.316156:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175497.316311:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251081856:12345-192.168.201.18@tcp:36:rm.0 Request processed in 3983us (4287us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789175497.316321:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00010000:00010000:0.0:1789175497.316500:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175497.316510:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.316517:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175497.316521:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.316539:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.316549:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97e7051dba00) 00010000:00010000:0.0:1789175497.316552:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789175497.316555:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.316560:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c1683c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.316580:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175497.316591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175497.316593:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175497.322578:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322607:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322616:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322624:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.322632:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322651:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322675:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4a848b87 (ffff97e7051dbf00) 00010000:00010000:0.0:1789175497.322678:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.322684:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.322692:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c1682e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4a848b87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175497.325855:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175497.326064:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082112 00000100:00100000:1.0:1789175497.326079:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082112 00000100:00100000:1.0:1789175497.326155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1789175497.326177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:9702:x1876086251082112:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:1.0:1789175497.327040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251082112:12345-192.168.201.18@tcp:35:rm.0 Request processed in 865us (1436us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789175497.328005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1789175497.333104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175497.333285:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082368 00000100:00100000:0.0:1789175497.333309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082368 00000100:00100000:0.0:1789175497.333409:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:0.0:1789175497.333422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+16:9702:x1876086251082368:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1789175497.333508:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789175497.333565:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1c00/0x1112cdeac4c167fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b7c expref: 16 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333592:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1679b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b59 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333617:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175497.333639:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1675c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b4b expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333657:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175497.333667:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175497.333697:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333714:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333726:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333741:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333749:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.333765:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334136:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334151:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334159:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175497.334830:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789175497.334850:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334859:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334867:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334873:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.334877:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334887:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334900:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97e7102ec500) 00010000:00010000:0.0:1789175497.334903:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789175497.334907:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334914:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16851 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334939:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334950:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334957:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334963:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175497.334966:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334972:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334979:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ece00) 00010000:00010000:0.0:1789175497.334982:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175497.334985:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175497.334990:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16843 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175497.335003:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb7a8c09 reply state 00000000c16553a3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175497.335013:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175497.335123:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:9702:x1876086251082368:12345-192.168.201.18@tcp:36:rm.0 Request processed in 1700us (2030us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789175497.335134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00010000:00010000:1.0:1789175497.339799:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339824:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339833:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339859:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175497.339865:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339875:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339898:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97e7102ecb00) 00010000:00010000:1.0:1789175497.339901:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175497.339908:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175497.339915:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1684a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175498.209974:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175499.236613:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789175499.681679:0:6833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284640333501ns, next at 285640330398ns, rc = 0 00000100:00100000:2.0:1789175499.681808:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175499.681840:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274181248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175499.681951:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175499.682196:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181248 00000100:00100000:3.0:1789175499.682206:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181248 00000100:00100000:3.0:1789175499.682295:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789175499.682307:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274181248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175499.682380:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175499.682435:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274181248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175499.682443:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789175499.682497:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72e18f800 x1876086274181248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175499.682520:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274181248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789175499.682662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175500.193624:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274181760:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.193751:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.193832:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789175500.193839:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274181376:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.193873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.193898:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274181888:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.193923:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.193953:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274181504:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.193975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.193994:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274182016:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194016:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.194046:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175500.194051:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274181632:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.194112:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181760 00000100:00100000:1.0:1789175500.194132:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181760 00000100:00100000:1.0:1789175500.194198:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182016 00000100:00100000:1.0:1789175500.194202:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182016 00000100:00100000:1.0:1789175500.194237:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789175500.194249:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274181760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194314:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274181760:12345-0@lo:400:kworker.0 Request processed in 66us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194322:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789175500.194387:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789175500.194395:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274182016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194430:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274182016:12345-0@lo:400:kworker.0 Request processed in 36us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194436:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789175500.194457:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181376 00000100:00100000:1.0:1789175500.194461:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181376 00000100:00100000:1.0:1789175500.194489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789175500.194496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274181376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194527:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274181376:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194534:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789175500.194565:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181888 00000100:00100000:1.0:1789175500.194568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181888 00000100:00100000:1.0:1789175500.194593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181504 00000100:00100000:1.0:1789175500.194595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181504 00000100:00100000:1.0:1789175500.194614:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274181632 00000100:00100000:1.0:1789175500.194617:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274181632 00000100:00100000:1.0:1789175500.194632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789175500.194638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274181888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274181888:12345-0@lo:400:kworker.0 Request processed in 30us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789175500.194684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789175500.194689:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274181504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194714:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274181504:12345-0@lo:400:kworker.0 Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194719:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789175500.194729:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789175500.194734:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274181632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194757:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274181632:12345-0@lo:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.194762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1789175500.194781:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789175500.194787:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175500.194828:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274181632:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194838:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274181504:0@lo:400:kworker.0 00010000:00080000:1.0:1789175500.194850:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734374a80 x1876086274182016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175500.194861:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274182016:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194895:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274181376:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.194912:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274181888:0@lo:400:kworker.0 00010000:00080000:1.0:1789175500.194921:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e734376300 x1876086274181760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175500.194931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274181760:0@lo:400:kworker.0 00000100:00100000:1.0:1789175500.199401:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175500.199432:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274182144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175500.199519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175500.199577:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182144 00000100:00100000:1.0:1789175500.199587:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182144 00000100:00100000:1.0:1789175500.199645:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789175500.199655:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274182144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175500.199700:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175500.199747:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274182144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175500.199755:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789175500.199803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25c700 x1876086274182144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175500.199825:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274182144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789175500.257780:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175501.286081:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789175501.635676:0:11615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789175501.974801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175501.974896:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175501.974944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175501.974987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175501.975039:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082624 00000100:00100000:2.0:1789175501.975051:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082624 00000100:00100000:2.0:1789175501.975134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082880 00000100:00100000:2.0:1789175501.975138:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082880 00000100:00100000:2.0:1789175501.975173:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1789175501.975187:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2354:x1876086251082624:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175501.975301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2354:x1876086251082624:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175501.975310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1789175501.975331:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:2.0:1789175501.975460:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251082880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175501.975494:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251082880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 156us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175501.975501:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00080000:2.0:1789175501.975524:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175501.976463:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082752 00000100:00100000:3.0:1789175501.976473:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082752 00000100:00100000:3.0:1789175501.976558:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:3.0:1789175501.976568:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251082752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175501.976632:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251082752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 66us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175501.976641:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00080000:2.0:1789175501.977007:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175501.977299:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251082496 00000100:00100000:0.0:1789175501.977306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251082496 00000100:00100000:0.0:1789175501.977480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 247 00000100:00100000:0.0:1789175501.977490:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251082496:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175501.977564:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251082496:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 76us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175501.977570:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 247 00010000:00010000:2.0:1789175502.309948:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789175502.332650:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789175502.332689:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789175502.332717:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789175502.332948:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175502.332980:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274182272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789175502.333053:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175502.333136:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182272 00000100:00100000:1.0:1789175502.333193:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182272 00000100:00100000:1.0:1789175502.333319:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789175502.333373:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274182272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789175502.333410:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789175502.333454:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4a6c9, atime: 0x6aa4a6c9, ctime: 0x6aa4a6c9, blocks: 0x1 00010000:00010000:1.0:1789175502.333463:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.333483:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1789175502.333489:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175502.333497:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.333518:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.333532:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.333541:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.333560:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789175502.334249:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274182272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 905us (1192us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789175502.334260:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789175502.334301:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175502.334309:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.334334:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175502.334363:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.334375:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.334398:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.334407:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000499bdfc5/0x1112cdeac4c16858 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.334432:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175502.334434:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175502.334436:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789175502.334632:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e602d36300/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789175502.334641:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274182272:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789175502.334774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789175502.897112:0:11663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd73d7ee50 20000000:00000080:3.0:1789175502.897135:0:11663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e73be56800 uarg=0000000000000000 20000000:01000000:3.0:1789175502.897187:0:11663:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789175502.897415:0:11663:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789175502.897423:0:11663:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789175502.903160:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789175502.903785:0:11663:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789175502.913286:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789175502.913403:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789175502.913461:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789175502.913491:0:11663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789175502.913513:0:11663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913536:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913543:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913558:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913576:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913580:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913587:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913632:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913649:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 18 pid: 5833 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.913663:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182400:0@lo:104: 00000100:00100000:1.0:1789175502.913742:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789175502.913822:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913830:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 18 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175502.913838:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182400 00000100:00100000:1.0:1789175502.913838:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182528:0@lo:104: 00000100:00100000:2.0:1789175502.913855:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182400 00000100:00100000:1.0:1789175502.913859:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789175502.913892:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913905:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 18 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175502.913906:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182528 00000100:00100000:2.0:1789175502.913909:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182528 00000100:00100000:1.0:1789175502.913915:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182656:0@lo:104: 00000100:00100000:2.0:1789175502.913925:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789175502.913935:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11663:x1876086274182400:12345-0@lo:104: 00000100:00100000:1.0:1789175502.913940:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789175502.913950:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913957:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175502.913966:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 12 pid: 5830 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.913976:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182784:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175502.914040:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.914047:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789175502.914049:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.914057:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182912:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175502.914061:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789175502.914066:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789175502.914484:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175502.914493:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11663:x1876086274182400:12345-0@lo:104: Request processed in 559us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175502.914502:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789175502.914524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274182656 00000100:00100000:2.0:1789175502.914529:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274182656 00000100:00100000:2.0:1789175502.914545:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175502.914551:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11663:x1876086274182528:12345-0@lo:104: 00010000:00010000:2.0:1789175502.914561:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914598:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789175502.914604:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+4:11663:x1876086274182528:12345-0@lo:104: Request processed in 54us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175502.914610:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789175502.914623:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789175502.914629:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e43a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11663:x1876086274182656:12345-0@lo:104: 00010000:00010000:2.0:1789175502.914638:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914671:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789175502.914684:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e43a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+3:11663:x1876086274182656:12345-0@lo:104: Request processed in 56us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175502.914691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789175502.914865:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789175502.914872:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914881:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175502.914885:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914893:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175502.914900:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175502.914906:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789175502.914936:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914943:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175502.914968:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914974:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0800/0x1112cdeac4c16724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1672b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.914990:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789175502.914994:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915025:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175502.915028:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915034:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175502.915050:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175502.915055:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789175502.915078:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915085:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175502.915102:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915110:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705668600/0x1112cdeac4c16716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1671d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915121:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175502.915124:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915130:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175502.915132:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915150:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175502.915157:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175502.915162:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789175502.915188:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915195:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175502.915202:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175502.915209:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7050f8800/0x1112cdeac4c16708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.915526:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175502.915542:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274183040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175502.915592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175502.915636:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175502.915648:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183040 00000100:00100000:3.0:1789175502.915653:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183040 00010000:00010000:3.0:1789175502.915677:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 19 pid: 5833 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.915706:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789175502.915713:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274183040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175502.915726:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175502.915732:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 19 pid: 5833 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.915753:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 19 pid: 5833 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.915774:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175502.915805:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274183040:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175502.915812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789175502.915833:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175502.915854:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274183040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175502.915885:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274183168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175502.915910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175502.915939:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175502.915944:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274183296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175502.915964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175502.915984:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183168 00000100:00100000:3.0:1789175502.915987:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183168 00010000:00010000:3.0:1789175502.916000:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 19 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.916016:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183296 00000100:00100000:3.0:1789175502.916018:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183296 00010000:00010000:3.0:1789175502.916027:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 20 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.916040:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789175502.916045:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274183168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175502.916052:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175502.916056:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 20 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.916082:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 20 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.916093:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175502.916113:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789175502.916119:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274183168:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175502.916124:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707446450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274183296:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175502.916125:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789175502.916133:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175502.916139:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 19 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175502.916149:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 19 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.916150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274183168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789175502.916159:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175502.916199:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707446450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274183296:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175502.916202:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274183296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175502.916206:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789175502.918224:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175502.918227:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175502.918230:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175502.919450:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7266ebf00 going to sleep for 11 seconds 00010000:00010000:1.0:1789175502.919499:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e705668e00/0x1112cdeac4c1672b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16724 expref: 18 pid: 5833 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.919518:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182400:0@lo:104: 00010000:00010000:1.0:1789175502.919534:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9800/0x1112cdeac4c1671d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16716 expref: 17 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.919567:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182528:0@lo:104: 00010000:00010000:1.0:1789175502.920799:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f8e00/0x1112cdeac4c1670f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c16708 expref: 16 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175502.920815:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182656:0@lo:104: 00000100:00100000:1.0:1789175502.920826:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182784:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175502.922923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175502.923006:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083008 00000100:00100000:3.0:1789175502.923018:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083008 00010000:00010000:3.0:1789175502.923083:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.923134:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1789175502.923147:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251083008:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175502.923178:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175502.923185:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.923210:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.923243:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9e00/0x1112cdeac4c16701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b3d expref: 13 pid: 5830 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.923267:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175502.923561:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:2353:x1876086251083008:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 414us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175502.923571:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1789175502.938651:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876086274182912:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175502.938710:0:11663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175502.941841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175502.944408:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083136 00000100:00100000:3.0:1789175502.944432:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083136 00010000:00010000:3.0:1789175502.944518:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.944574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1789175502.944588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:2354:x1876086251083136:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175502.944608:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175502.944617:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944633:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944657:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e705668a00/0x1112cdeac4c166fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b36 expref: 12 pid: 5833 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944681:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944692:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944713:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944722:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944748:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944756:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944762:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175502.944768:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944778:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944797:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175502.944811:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175502.944836:0:11663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175502.944855:0:11663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175502.944862:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654a400/0x1112cdeac4c1685f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175502.945030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2354:x1876086251083136:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 443us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175502.945039:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00010000:00010000:1.0:1789175503.332197:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175504.129598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175504.129714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083264 00000100:00100000:1.0:1789175504.129729:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083264 00000100:00100000:1.0:1789175504.129806:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 248 00000100:00100000:1.0:1789175504.129819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:5596:x1876086251083264:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175504.129841:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175504.129877:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b400/0x1112cdeac4c16866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b8a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.129915:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b400/0x1112cdeac4c16866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b8a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.129928:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b400/0x1112cdeac4c16866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b8a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.129939:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b400, rc 0) 00000100:00100000:1.0:1789175504.130062:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083264:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 245us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.130070:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 248 00000100:00100000:1.0:1789175504.137702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175504.137855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083392 00000100:00100000:0.0:1789175504.137870:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083392 00000100:00100000:0.0:1789175504.137947:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 249 00000100:00100000:0.0:1789175504.137961:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083392:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.138489:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083392:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 529us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175504.138500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 249 00000100:00100000:3.0:1789175504.142015:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175504.142159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083520 00000100:00100000:2.0:1789175504.142175:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083520 00000100:00100000:2.0:1789175504.142264:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 250 00000100:00100000:2.0:1789175504.142287:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083520:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.142838:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083520:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 560us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.142857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 250 00000100:00100000:2.0:1789175504.152146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175504.152320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083648 00000100:00100000:1.0:1789175504.152334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083648 00000100:00100000:1.0:1789175504.152451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 251 00000100:00100000:1.0:1789175504.152464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:9972:x1876086251083648:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175504.152924:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:9972:x1876086251083648:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 461us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.152936:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 251 00000100:00100000:1.0:1789175504.158772:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175504.159031:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083776 00000100:00100000:0.0:1789175504.159047:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083776 00000100:00100000:0.0:1789175504.159131:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 252 00000100:00100000:0.0:1789175504.159144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:9972:x1876086251083776:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789175504.159925:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:9972:x1876086251083776:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 778us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175504.159937:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 252 00000100:00100000:3.0:1789175504.185961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175504.186251:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251083904 00000100:00100000:2.0:1789175504.186265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251083904 00000100:00100000:2.0:1789175504.186388:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 253 00000100:00100000:2.0:1789175504.186403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:5596:x1876086251083904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175504.186427:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175504.186453:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c1686d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b91 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.186492:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c1686d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b91 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.186506:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c1686d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b91 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.186519:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1c00, rc 0) 00000100:00100000:2.0:1789175504.186608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251083904:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 207us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.186617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 253 00000100:00100000:2.0:1789175504.191377:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175504.191577:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084032 00000100:00100000:1.0:1789175504.191590:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084032 00000100:00100000:1.0:1789175504.191659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 254 00000100:00100000:1.0:1789175504.191671:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251084032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175504.192538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251084032:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 865us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.192549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 254 00000100:00100000:1.0:1789175504.204711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175504.208764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084160 00000100:00100000:2.0:1789175504.208785:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084160 00000100:00100000:2.0:1789175504.208880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 255 00000100:00100000:2.0:1789175504.208892:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251084160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.209610:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7070a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:5596:x1876086251084160:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 717us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.209629:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 255 00000100:00100000:3.0:1789175504.212004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175504.212724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084288 00000100:00100000:2.0:1789175504.212741:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084288 00000100:00100000:2.0:1789175504.212832:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 256 00000100:00100000:2.0:1789175504.212845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:9975:x1876086251084288:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175504.213597:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:9975:x1876086251084288:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 751us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.213608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 256 00000100:00100000:3.0:1789175504.219503:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175504.219755:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084416 00000100:00100000:2.0:1789175504.219769:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084416 00000100:00100000:2.0:1789175504.219844:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 257 00000100:00100000:2.0:1789175504.219857:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:9975:x1876086251084416:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175504.220197:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:9975:x1876086251084416:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 337us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.220207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 257 10000000:01000000:0.0:1789175504.353785:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175504.353801:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7264f7000 from 7 10000000:01000000:0.0:1789175504.353808:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175504.354268:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.354285:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.354322:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175504.354385:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.354516:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175504.354774:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175504.355181:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175504.355613:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183424 00000100:00100000:1.0:1789175504.355626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183424 00000100:00100000:1.0:1789175504.355915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789175504.355929:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:5835:x1876086274183424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175504.355951:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175504.355973:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b000/0x1112cdeac4c1687b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16874 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.356030:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b000/0x1112cdeac4c1687b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16874 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.356054:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b000/0x1112cdeac4c1687b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16874 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.356067:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b000, rc 0) 00000100:00100000:0.0:1789175504.356305:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175504.356328:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.356375:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175504.356491:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.356554:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175504.356712:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274183424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.356722:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789175504.362107:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175504.362375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183552 00000100:00100000:1.0:1789175504.362388:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183552 00000100:00100000:1.0:1789175504.362459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789175504.362471:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274183552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175504.363220:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274183552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 747us (6661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.363231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789175504.363718:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.363797:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.363873:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175504.363926:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175504.364980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183680 00000100:00100000:1.0:1789175504.364991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183680 00000100:00100000:1.0:1789175504.365055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789175504.365066:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274183680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175504.365720:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274183680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 652us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.365730:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789175504.365904:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274183680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.367024:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11678:1876086274183808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175504.367125:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175504.367422:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.370383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183808 00000100:00100000:2.0:1789175504.370410:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183808 00000100:00100000:2.0:1789175504.370518:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789175504.374005:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:11678:x1876086274183808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.374947:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:11678:x1876086274183808:12345-0@lo:502:llog_process_th.0 Request processed in 4414us (7817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.374961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789175504.375748:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11678:1876086274183808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789175504.375801:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175504.375816:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175504.375820:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789175504.375828:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e7264f7000 00000020:00000080:0.0:1789175504.375842:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789175504.375982:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11678:1876086274183936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175504.376068:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175504.376122:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.378397:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274183936 00000100:00100000:2.0:1789175504.378418:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274183936 00000100:00100000:2.0:1789175504.378520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789175504.379320:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:11678:x1876086274183936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.381796:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:11678:x1876086274183936:12345-0@lo:502:llog_process_th.0 Request processed in 2471us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.381817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789175504.381972:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11678:1876086274183936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789175504.382026:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175504.382038:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175504.382041:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789175504.382079:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789175504.382513:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789175504.382658:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789175504.382672:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.382686:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175504.382700:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175504.382703:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73c3b2800 from 7 10000000:01000000:0.0:1789175504.382706:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175504.382758:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.382767:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.382793:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175504.382820:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.384005:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175504.384077:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.384383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184064 00000100:00100000:2.0:1789175504.384395:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184064 00000100:00100000:2.0:1789175504.384467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789175504.384478:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:5835:x1876086274184064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175504.385992:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175504.386026:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16889 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16882 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.386090:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16882 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.386104:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16882 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175504.386116:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a0c00, rc 0) 00000100:00100000:2.0:1789175504.387041:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2559us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.387064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789175504.388705:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175504.388744:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175504.388760:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175504.390709:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175504.390813:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175504.391762:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e733e55000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.392320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184192 00000100:00100000:2.0:1789175504.392333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184192 00000100:00100000:2.0:1789175504.392455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789175504.392467:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.397425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70701b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4949us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.397463:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789175504.397495:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.397589:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.397677:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.397741:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e709ea1240 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.397753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184320 00000100:00100000:2.0:1789175504.397766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184320 00000100:00100000:2.0:1789175504.397833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789175504.397846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.398079:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.398086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789175504.398160:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.403657:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11680:1876086274184448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.403775:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175504.403829:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175504.404055:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184448 00000100:00100000:3.0:1789175504.404065:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184448 00000100:00100000:3.0:1789175504.404132:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789175504.404144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:11680:x1876086274184448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175504.410998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:11680:x1876086274184448:12345-0@lo:502:llog_process_th.0 Request processed in 6837us (7205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.411019:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789175504.411772:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11680:1876086274184448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175504.411982:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175504.411996:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175504.411998:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789175504.412007:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e73c3b2800 00000020:00000080:2.0:1789175504.412010:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789175504.412149:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11680:1876086274184576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.413012:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175504.413079:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030180 going to sleep for 11 seconds 00000100:00100000:1.0:1789175504.413961:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184576 00000100:00100000:1.0:1789175504.413975:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184576 00000100:00100000:1.0:1789175504.414064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789175504.414075:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:11680:x1876086274184576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175504.415139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:11680:x1876086274184576:12345-0@lo:502:llog_process_th.0 Request processed in 1062us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175504.415151:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789175504.415975:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11680:1876086274184576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175504.416036:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175504.416057:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175504.416067:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789175504.416073:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789175504.416240:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789175504.416275:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175504.416288:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.416298:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175504.416309:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789175504.416311:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7201da000 from 7 10000000:01000000:3.0:1789175504.416314:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175504.416773:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.416784:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.416795:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175504.416825:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.416917:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.416991:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e709ea1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175504.417028:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184704 00000100:00100000:3.0:1789175504.417036:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184704 00000100:00100000:3.0:1789175504.417101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789175504.417112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:5835:x1876086274184704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175504.417126:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175504.417141:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9200/0x1112cdeac4c16897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c16890 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.417169:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9200/0x1112cdeac4c16897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c16890 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.417180:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9200/0x1112cdeac4c16897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c16890 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.417189:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9200, rc 0) 00000100:00100000:3.0:1789175504.417228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274184704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.417235:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789175504.417286:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175504.417307:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175504.417320:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175504.419138:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.419217:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.419265:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e709ea1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175504.419292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184832 00000100:00100000:3.0:1789175504.419298:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184832 00000100:00100000:3.0:1789175504.419357:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789175504.419373:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274184832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.419632:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274184832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.419641:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789175504.419677:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.419706:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.419748:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.419785:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e709ea1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175504.419805:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274184960 00000100:00100000:3.0:1789175504.419809:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274184960 00000100:00100000:3.0:1789175504.419835:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789175504.419841:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274184960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175504.419974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:5835:x1876086274184960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.419981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789175504.420692:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:5835:1876086274184960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175504.421837:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11682:1876086274185088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.421914:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175504.423908:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030240 going to sleep for 11 seconds 00000100:00100000:3.0:1789175504.424059:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185088 00000100:00100000:3.0:1789175504.424069:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185088 00000100:00100000:3.0:1789175504.424245:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789175504.424260:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:11682:x1876086274185088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175504.424932:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:11682:x1876086274185088:12345-0@lo:502:llog_process_th.0 Request processed in 674us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.424949:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789175504.425107:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711041880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11682:1876086274185088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175504.425211:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175504.425224:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175504.425226:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789175504.425235:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e7201da000 00000020:00000080:2.0:1789175504.425239:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789175504.425666:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11682:1876086274185216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175504.425731:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.425768:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e709ea1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789175504.425830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185216 00000100:00100000:2.0:1789175504.425837:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185216 00000100:00100000:2.0:1789175504.425882:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789175504.425891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:11682:x1876086274185216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175504.426326:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:11682:x1876086274185216:12345-0@lo:502:llog_process_th.0 Request processed in 436us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175504.426334:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789175504.426673:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:11682:1876086274185216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789175504.426698:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789175504.426705:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175504.426707:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789175504.426712:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789175504.427492:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789175504.427544:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789175504.427558:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175504.427572:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175504.444486:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789175504.802466:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175504.802551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175504.803508:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185344 00000100:00100000:3.0:1789175504.803517:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185344 00000100:00100000:3.0:1789175504.803586:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789175504.803596:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175504.803630:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175504.803697:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175504.803705:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789175504.803824:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175504.803965:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175505.315434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274185600:0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.315550:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175505.315624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274186112:0@lo:400:kworker.0 00000100:00100000:3.0:1789175505.315640:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274185728:0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.315656:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175505.315673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175505.315691:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274186240:0@lo:400:kworker.0 00000100:00100000:3.0:1789175505.315718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175505.315718:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274185856:0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.315744:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175505.315756:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186240 00000100:00100000:1.0:1789175505.315763:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789175505.315766:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186240 00000100:00100000:1.0:1789175505.315768:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175505.315790:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175505.315829:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185984:0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.315852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175505.315966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186112 00000100:00100000:2.0:1789175505.315970:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186112 00000100:00100000:2.0:1789175505.316006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185728 00000100:00100000:2.0:1789175505.316009:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185728 00000100:00100000:2.0:1789175505.316025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185856 00000100:00100000:2.0:1789175505.316038:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185856 00000100:00100000:2.0:1789175505.316060:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789175505.316071:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175505.316143:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274186112:12345-0@lo:400:kworker.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175505.316170:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789175505.316190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789175505.316195:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274185728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175505.316241:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274185728:12345-0@lo:400:kworker.0 Request processed in 45us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175505.316248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789175505.316261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789175505.316267:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274185856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175505.316300:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274185856:12345-0@lo:400:kworker.0 Request processed in 34us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175505.316306:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789175505.320220:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185472 00000100:00100000:1.0:1789175505.320245:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185472 00000100:00100000:1.0:1789175505.320363:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789175505.320376:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175505.320430:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175505.320537:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (4744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175505.320545:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789175505.320587:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185984 00000100:00100000:1.0:1789175505.320592:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185984 00000100:00100000:1.0:1789175505.320615:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789175505.320622:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274186240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.320660:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274186240:12345-0@lo:400:kworker.0 Request processed in 38us (4941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175505.320666:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789175505.320680:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789175505.320686:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.320714:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274185984:12345-0@lo:400:kworker.0 Request processed in 29us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175505.320720:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789175505.320744:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789175505.320752:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175505.320805:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274186112:0@lo:400:kworker.0 00010000:00080000:1.0:1789175505.320857:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25f100 x1876086274185472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175505.320900:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175505.320917:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274185984:0@lo:400:kworker.0 00000100:00100000:1.0:1789175505.320931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274185856:0@lo:400:kworker.0 00000100:00100000:0.0:1789175505.324451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274185600 00000100:00100000:0.0:1789175505.324474:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274185600 00000100:00100000:0.0:1789175505.324593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789175505.324610:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274185600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175505.324771:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274185600:12345-0@lo:400:kworker.0 Request processed in 166us (9221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175505.324779:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789175505.324830:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274185600:0@lo:400:kworker.0 00000100:00100000:2.0:1789175505.326438:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274185728:0@lo:400:kworker.0 00010000:00080000:2.0:1789175505.326464:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e733f51500 x1876086274186240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175505.326478:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274186240:0@lo:400:kworker.0 00010000:00010000:0.0:1789175505.377727:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789175505.506506:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789175506.401992:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175507.076666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175507.076719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175507.076767:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175507.076823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175507.076910:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084672 00000100:00100000:0.0:1789175507.076910:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084800 00000100:00100000:2.0:1789175507.076924:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084672 00000100:00100000:0.0:1789175507.076924:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084800 00000100:00100000:2.0:1789175507.077043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084928 00000100:00100000:2.0:1789175507.077047:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084928 00000100:00100000:1.0:1789175507.077104:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251084544 00000100:00100000:1.0:1789175507.077109:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251084544 00000100:00100000:1.0:1789175507.077150:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 274 00000100:00100000:0.0:1789175507.077392:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:0.0:1789175507.077408:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251084800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175507.077505:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251084800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 102us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175507.077513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1789175507.077716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251084544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175507.077753:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251084544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 43us (1120us total) trans 0 rc 0/0 00000100:00080000:3.0:1789175507.077829:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789175507.077836:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175507.077861:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:3.0:1789175507.077871:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251084672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175507.077908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251084672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175507.077915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1789175507.091450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:2.0:1789175507.091479:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251084928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175507.091607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2355:x1876086251084928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 136us (14782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175507.093046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 274 00000100:00100000:2.0:1789175507.099381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00010000:00010000:1.0:1789175507.433093:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789175507.499699:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1789175508.453376:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175509.473598:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175509.921691:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175509.921721:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274186368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175509.921802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175509.922120:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186368 00000100:00100000:3.0:1789175509.922132:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186368 00000100:00100000:3.0:1789175509.922215:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789175509.922226:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274186368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175509.922263:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175509.922315:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274186368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175509.922323:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789175509.922411:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175509.922444:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789175509.922450:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e602d36300, transno 4294967300 00000100:00100000:2.0:1789175509.922479:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274186368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175510.433829:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175510.433919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175510.434074:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186496 00000100:00100000:1.0:1789175510.434084:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186496 00000100:00100000:1.0:1789175510.434163:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175510.434186:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274186496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175510.434236:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175510.434286:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274186496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175510.434293:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789175510.434420:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789175510.434463:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25f100 x1876086274186496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175510.434484:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175510.434973:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274186880:0@lo:400:kworker.0 00000100:00100000:2.0:1789175510.434995:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274186624:0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.435018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175510.435029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175510.435061:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274187136:0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.435065:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175510.435070:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274187008:0@lo:400:kworker.0 00000100:00100000:2.0:1789175510.435085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175510.435091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175510.435102:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175510.435106:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274186752:0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.435114:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186624 00000100:00100000:0.0:1789175510.435119:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186624 00000100:00100000:2.0:1789175510.435127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175510.435153:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789175510.435163:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274186624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.435212:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274186624:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175510.435218:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789175510.435287:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274186624:0@lo:400:kworker.0 00000100:00100000:1.0:1789175510.435329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186880 00000100:00100000:1.0:1789175510.435335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186880 00000100:00100000:1.0:1789175510.435397:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187136 00000100:00100000:1.0:1789175510.435413:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187136 00000100:00100000:2.0:1789175510.435427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274186752 00000100:00100000:2.0:1789175510.435431:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274186752 00000100:00100000:1.0:1789175510.435460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789175510.435642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274186880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175510.435685:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274186880:12345-0@lo:400:kworker.0 Request processed in 46us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175510.436694:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274186880:0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.436763:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187008 00000100:00100000:0.0:1789175510.436771:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187008 00000100:00100000:0.0:1789175510.436843:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789175510.436852:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274187008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175510.436931:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274187008:12345-0@lo:400:kworker.0 Request processed in 81us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175510.436974:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789175510.437011:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274187008:0@lo:400:kworker.0 00000100:00080000:0.0:1789175510.437041:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175510.443695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789175510.443733:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274186752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175510.443874:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274186752:12345-0@lo:400:kworker.0 Request processed in 163us (8744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175510.443883:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789175510.443920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789175510.448365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274187136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175510.448476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274187136:12345-0@lo:400:kworker.0 Request processed in 4535us (13390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175510.448487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789175510.448569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274186752:0@lo:400:kworker.0 00000100:00100000:2.0:1789175510.448583:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274187136:0@lo:400:kworker.0 00000100:00100000:1.0:1789175510.451930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:2.0:1789175510.498795:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175511.521479:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175512.198028:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175512.198085:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175512.198097:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085056 00000100:00100000:1.0:1789175512.198107:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085056 00000100:00100000:0.0:1789175512.198125:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175512.198158:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 276 00000100:00100000:0.0:1789175512.198161:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175512.198168:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251085056:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175512.198207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085184 00000100:00100000:0.0:1789175512.198211:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085184 00000100:00100000:0.0:1789175512.198246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085440 00000100:00100000:1.0:1789175512.198248:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251085056:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175512.198248:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085440 00000100:00100000:1.0:1789175512.198255:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 276 00000100:00100000:0.0:1789175512.198271:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:0.0:1789175512.198278:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251085184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175512.198311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251085184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175512.198318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:0.0:1789175512.198329:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:0.0:1789175512.198335:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251085440:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175512.198389:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251085440:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175512.198395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00080000:0.0:1789175512.198412:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175512.198487:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085312 00000100:00100000:2.0:1789175512.198492:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085312 00000100:00100000:2.0:1789175512.198554:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1789175512.198562:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251085312:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175512.198597:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251085312:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175512.198604:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00080000:0.0:1789175512.199205:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789175512.545777:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175513.583398:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175514.600566:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175515.045817:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789175515.045844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274187264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175515.045938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175515.046008:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187264 00000100:00100000:1.0:1789175515.046016:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187264 00000100:00100000:1.0:1789175515.046085:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175515.046095:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274187264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175515.046130:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789175515.046151:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175515.046174:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274187264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175515.046181:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175515.046230:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274187264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175515.553708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274187392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175515.553792:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274187776:0@lo:400:kworker.0 00000100:00100000:3.0:1789175515.553809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175515.553862:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175515.553901:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274187904:0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.553901:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789175515.553912:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274187648:0@lo:400:kworker.0 00000100:00100000:3.0:1789175515.553938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175515.553969:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789175515.553977:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187392 00000100:00100000:3.0:1789175515.553978:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274187520:0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.553986:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187392 00000100:00100000:3.0:1789175515.554013:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175515.554039:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274188032:0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554050:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789175515.554063:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274187392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175515.554070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789175515.554104:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175515.554105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175515.554139:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187776 00000100:00100000:3.0:1789175515.554145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187776 00000100:00100000:2.0:1789175515.554164:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274187392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175515.554173:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789175515.554184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187904 00000100:00100000:3.0:1789175515.554188:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187904 00000100:00100000:2.0:1789175515.554202:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187648 00000100:00100000:2.0:1789175515.554207:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187648 00000100:00100000:3.0:1789175515.554227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789175515.554234:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789175515.554239:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274187776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554247:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274187904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175515.554295:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274187776:12345-0@lo:400:kworker.0 Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175515.554298:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274187904:12345-0@lo:400:kworker.0 Request processed in 53us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175515.554307:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789175515.554469:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789175515.554484:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789175515.554491:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274187648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554523:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274187648:12345-0@lo:400:kworker.0 Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175515.554529:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789175515.554563:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274187904:0@lo:400:kworker.0 00010000:00080000:2.0:1789175515.554577:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25df80 x1876086274187392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175515.554591:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274187392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175515.554629:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274187648:0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554638:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274187776:0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554663:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188032 00000100:00100000:2.0:1789175515.554667:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188032 00000100:00100000:2.0:1789175515.554692:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789175515.554698:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274188032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175515.554740:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274187520 00000100:00100000:3.0:1789175515.554745:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274187520 00000100:00100000:2.0:1789175515.554748:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274188032:12345-0@lo:400:kworker.0 Request processed in 49us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175515.554757:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789175515.554782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00010000:00080000:2.0:1789175515.554791:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e711040700 x1876086274188032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175515.554793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274187520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175515.554810:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274188032:0@lo:400:kworker.0 00000100:00080000:2.0:1789175515.554848:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789175515.554866:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175515.555428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274187520:12345-0@lo:400:kworker.0 Request processed in 636us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175515.555436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789175515.555451:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274187520:0@lo:400:kworker.0 00010000:00010000:1.0:1789175515.617608:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789175515.810489:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789175516.641729:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175517.318902:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175517.318965:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175517.319067:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085568 00000100:00100000:2.0:1789175517.319078:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085568 00000100:00100000:2.0:1789175517.319155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 278 00000100:00100000:2.0:1789175517.319166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251085568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175517.319252:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251085568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175517.319259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 278 00000100:00100000:1.0:1789175517.319673:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085696 00000100:00100000:1.0:1789175517.319679:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085696 00000100:00100000:1.0:1789175517.319741:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1789175517.319750:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251085696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175517.319802:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251085696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175517.319809:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00080000:2.0:1789175517.319968:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175517.340415:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175517.340517:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085824 00000100:00100000:1.0:1789175517.340527:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085824 00000100:00100000:1.0:1789175517.340607:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1789175517.340628:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2352:x1876086251085824:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1789175517.340661:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c167d3 00000100:00080000:1.0:1789175517.340669:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e734021000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789175517.340718:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789175517.340862:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789175517.341233:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175517.342981:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+2:2352:x1876086251085824:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 2347us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175517.342995:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1789175517.343263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175517.347589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251085952 00000100:00100000:1.0:1789175517.347605:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251085952 00000100:00100000:1.0:1789175517.347851:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:1.0:1789175517.347863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251085952:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175517.347955:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251085952:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (4692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175517.347963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00080000:2.0:1789175517.359010:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789175517.665644:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789175517.667111:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:3.0:1789175517.667119:0:6713:0:(genops.c:885:class_export_put()) final put ffff97e734025800/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175517.667191:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734025800/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-OST0000 00000020:00000080:2.0:1789175517.667256:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e734021000 for lustre-OST0000 00010000:00010000:1.0:1789175518.689985:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175519.713640:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175520.164895:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175520.164920:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274188160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175520.164993:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175520.165060:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188160 00000100:00100000:2.0:1789175520.165069:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188160 00000100:00100000:2.0:1789175520.165134:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789175520.165161:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274188160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175520.165201:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175520.165254:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274188160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00080000:3.0:1789175520.165327:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175520.165384:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274188160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175520.166092:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789175520.673637:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274188672:0@lo:400:kworker.0 00000100:00100000:0.0:1789175520.673637:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274188288:0@lo:400:kworker.0 00000100:00100000:3.0:1789175520.673983:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274188416:0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.674061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175520.674132:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274188544:0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.674158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175520.674196:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188672 00000100:00100000:2.0:1789175520.674205:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188672 00000100:00100000:2.0:1789175520.674277:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188544 00000100:00100000:2.0:1789175520.674281:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188544 00000100:00100000:2.0:1789175520.674309:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789175520.674319:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.674397:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274188672:12345-0@lo:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175520.674405:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789175520.674421:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789175520.674428:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274188544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.674459:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274188544:12345-0@lo:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175520.676424:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789175520.676531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274188544:0@lo:400:kworker.0 00000100:00080000:2.0:1789175520.676561:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175520.676598:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274188672:0@lo:400:kworker.0 00000100:00100000:0.0:1789175520.680750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175520.680844:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274188800:0@lo:400:kworker.0 00000100:00100000:0.0:1789175520.680900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175520.680962:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188800 00000100:00100000:0.0:1789175520.680971:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188800 00000100:00100000:0.0:1789175520.681038:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789175520.681049:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274188800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175520.681104:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274188800:12345-0@lo:400:kworker.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175520.681111:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789175520.681243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188288 00000100:00100000:2.0:1789175520.681249:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188288 00000100:00100000:2.0:1789175520.681279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789175520.681287:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.681324:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274188288:12345-0@lo:400:kworker.0 Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175520.681330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1789175520.681509:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175520.681665:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274188288:0@lo:400:kworker.0 00010000:00080000:0.0:1789175520.681681:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e711040000 x1876086274188800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175520.681694:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274188800:0@lo:400:kworker.0 00000100:00100000:2.0:1789175520.698896:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175520.698967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274188928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175520.699002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175520.699136:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188416 00000100:00100000:1.0:1789175520.699158:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188416 00000100:00100000:1.0:1789175520.699220:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789175520.699230:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274188416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175520.699319:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274188416:12345-0@lo:400:kworker.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175520.699327:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789175520.699426:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274188928 00000100:00100000:3.0:1789175520.699431:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274188928 00000100:00100000:3.0:1789175520.699480:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789175520.699488:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274188928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175520.699517:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175520.699553:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274188928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175520.699559:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789175520.699649:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274188416:0@lo:400:kworker.0 00010000:00080000:0.0:1789175520.699665:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25df80 x1876086274188928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175520.699682:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274188928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789175520.737676:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175521.762822:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175522.436149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175522.436198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175522.436291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175522.436505:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086080 00000100:00100000:3.0:1789175522.436516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086080 00000100:00100000:3.0:1789175522.436575:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 280 00000100:00100000:3.0:1789175522.436586:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251086080:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175522.436661:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251086080:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 77us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175522.436669:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 280 00000100:00100000:1.0:1789175522.437847:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086208 00000100:00100000:1.0:1789175522.437856:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086208 00000100:00080000:3.0:1789175522.438002:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175522.438051:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086336 00000100:00100000:1.0:1789175522.438056:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086336 00000100:00100000:1.0:1789175522.438101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00080000:3.0:1789175522.438227:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175522.438404:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251086208:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175522.438479:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251086208:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 79us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175522.442504:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:3.0:1789175522.442537:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251086336:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175522.442629:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251086336:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 110us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175522.442638:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1789175522.455096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00010000:00010000:1.0:1789175522.785516:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175523.811060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175524.838182:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789175525.027829:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789175525.282912:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175525.282947:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274189056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175525.283051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175525.283132:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189056 00000100:00100000:0.0:1789175525.283142:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189056 00000100:00100000:0.0:1789175525.283211:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789175525.283222:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274189056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175525.283270:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175525.283324:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274189056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175525.283332:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789175525.283381:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175525.283427:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274189056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175525.793961:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274189440:0@lo:400:kworker.0 00000100:00100000:0.0:1789175525.794056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175525.794143:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175525.794150:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789175525.794173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175525.794206:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189440 00000100:00100000:0.0:1789175525.794215:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189440 00000100:00100000:0.0:1789175525.794278:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189568 00000100:00100000:0.0:1789175525.794282:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189568 00000100:00100000:0.0:1789175525.794308:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789175525.794320:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274189440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175525.794423:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274189440:12345-0@lo:400:kworker.0 Request processed in 105us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175525.794455:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789175525.794475:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789175525.794481:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274189568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175525.794512:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274189568:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175525.794518:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789175525.794536:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175525.794809:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274189568:0@lo:400:kworker.0 00000100:00100000:0.0:1789175525.794823:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274189440:0@lo:400:kworker.0 00000100:00100000:3.0:1789175525.794939:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274189312:0@lo:400:kworker.0 00000100:00100000:3.0:1789175525.795108:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175525.795128:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274189184:0@lo:400:kworker.0 00000100:00100000:2.0:1789175525.795180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175525.795191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189312 00000100:00100000:3.0:1789175525.795201:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189312 00000100:00100000:2.0:1789175525.795219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274189696:0@lo:400:kworker.0 00000100:00100000:2.0:1789175525.795256:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175525.795269:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789175525.795284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274189312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175525.795301:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189184 00000100:00100000:2.0:1789175525.795307:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189184 00000100:00100000:2.0:1789175525.795380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789175525.795391:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274189184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175525.795403:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274189312:12345-0@lo:400:kworker.0 Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175525.795437:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274189184:12345-0@lo:400:kworker.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175525.795444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789175525.795482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274189184:0@lo:400:kworker.0 00000100:00100000:3.0:1789175525.795508:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789175525.795553:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274189312:0@lo:400:kworker.0 00000100:00100000:1.0:1789175525.795933:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189696 00000100:00100000:1.0:1789175525.795938:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189696 00000100:00100000:1.0:1789175525.795982:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175525.795990:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274189696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175525.796032:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274189696:12345-0@lo:400:kworker.0 Request processed in 44us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175525.796039:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789175525.796384:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274189824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175525.796424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789175525.796945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e737cbca80 x1876086274189696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789175541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175525.796964:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274189696:0@lo:400:kworker.0 00000100:00100000:1.0:1789175525.797069:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189824 00000100:00100000:1.0:1789175525.797077:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189824 00000100:00100000:1.0:1789175525.797125:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789175525.797134:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274189824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789175525.797196:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175525.797258:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274189824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175525.797265:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789175525.797908:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e73c25f100 x1876086274189824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175525.797934:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274189824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789175525.798122:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789175525.857641:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175526.881443:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789175526.919464:0:11847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:12:06 (1789175526) 00000100:00100000:3.0:1789175527.552537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175527.552579:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175527.552613:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175527.552764:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086720 00000100:00100000:0.0:1789175527.552774:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086720 00000100:00100000:0.0:1789175527.552842:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086592 00000100:00100000:0.0:1789175527.552846:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086592 00000100:00100000:0.0:1789175527.552872:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:0.0:1789175527.552882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251086720:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175527.552945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2356:x1876086251086720:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 66us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175527.552950:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:0.0:1789175527.552962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:0.0:1789175527.552966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251086592:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175527.552982:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251086592:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 17us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175527.552994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:2.0:1789175527.553148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086464 00000100:00100000:2.0:1789175527.553151:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086464 00000100:00100000:2.0:1789175527.553181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 282 00000100:00100000:2.0:1789175527.553186:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251086464:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175527.553208:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2356:x1876086251086464:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175527.553212:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 282 00000100:00080000:3.0:1789175527.553270:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789175527.907228:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175528.379397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175528.379604:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086848 00000100:00100000:0.0:1789175528.379624:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086848 00000100:00100000:0.0:1789175528.379704:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1789175528.379715:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:10245:x1876086251086848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175528.379736:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175528.379761:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1689e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b98 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.379833:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.379849:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.379864:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175528.379901:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175528.379905:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175528.379948:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.379974:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1689e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b98 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.379995:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b98 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175528.380022:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175528.380025:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175528.380029:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669000, rc 0) 00000100:00100000:0.0:1789175528.380107:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:10245:x1876086251086848:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 394us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175528.380115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:3.0:1789175528.385602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175528.385736:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251086976 00000100:00100000:2.0:1789175528.385746:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251086976 00000100:00100000:2.0:1789175528.385815:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1789175528.385828:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:10246:x1876086251086976:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175528.385855:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175528.385877:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c168ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2b9f expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.385942:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.385958:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.385971:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386005:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386014:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386020:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386231:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386239:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386246:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175528.386273:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175528.386277:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175528.386298:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386309:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386315:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386322:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386376:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175528.386381:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386389:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386401:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:2.0:1789175528.386404:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175528.386408:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386414:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c168b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386425:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386431:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386436:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386440:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175528.386443:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386448:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386465:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97e7181cd800) 00010000:00010000:2.0:1789175528.386468:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175528.386471:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386478:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c168ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386510:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c168ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b9f expref: 8 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386525:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b9f expref: 7 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175528.386533:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7181cd500) 00010000:00010000:2.0:1789175528.386535:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175528.386538:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7013a1a00, rc 0) 00000100:00100000:2.0:1789175528.386886:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10246:x1876086251086976:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 786us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175528.386897:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1789175528.391904:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175528.392003:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251087232 00000100:00100000:1.0:1789175528.392013:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251087232 00000100:00100000:1.0:1789175528.392079:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:1.0:1789175528.392090:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10246:x1876086251087232:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175528.392111:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175528.392135:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c168c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ba6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392212:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392228:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392240:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392330:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392400:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392408:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392795:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c168dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392806:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c168dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392812:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c168dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175528.392822:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789175528.392973:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392981:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392988:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.392993:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175528.392998:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393005:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393016:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7181cd500) 00010000:00010000:1.0:1789175528.393019:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175528.393023:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393040:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393055:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393062:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393067:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393071:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175528.393074:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393080:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393087:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97e721b55000) 00010000:00010000:1.0:1789175528.393089:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175528.393092:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393098:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393605:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c168c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ba6 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393623:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c168dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ba6 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175528.393649:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:1.0:1789175528.393652:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175528.393655:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a400, rc 0) 00000100:00100000:1.0:1789175528.393719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10246:x1876086251087232:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1631us (1826us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789175528.393734:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1789175528.401230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175528.401422:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251087360 00000100:00100000:1.0:1789175528.401434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251087360 00000100:00100000:1.0:1789175528.401498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1789175528.401510:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10246:x1876086251087360:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789175528.401650:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10246:x1876086251087360:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 142us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175528.401658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00010000:00010000:1.0:1789175528.930555:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789175529.126609:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789175529.956210:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175530.406746:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274189952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175530.406823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175530.406906:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274189952 00000100:00100000:2.0:1789175530.406915:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274189952 00000100:00100000:2.0:1789175530.406974:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789175530.406994:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274189952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175530.407029:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175530.407070:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274189952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.407077:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789175530.407096:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175530.407133:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274189952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175530.589499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175530.590264:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251087488 00000100:00100000:1.0:1789175530.590276:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251087488 00000100:00100000:1.0:1789175530.590378:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:1.0:1789175530.590538:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10288:x1876086251087488:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175530.590561:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175530.590601:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bad expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590675:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590690:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590853:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590875:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590883:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.590891:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789175530.591209:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789175530.591281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591290:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591297:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591303:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175530.591308:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591315:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591327:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175530.591331:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175530.591336:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591646:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c168f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591662:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591668:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591674:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591680:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175530.591683:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591690:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.591699:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97e721b55600) 00010000:00010000:1.0:1789175530.591702:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175530.591706:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.592202:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c168f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.592251:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bad expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.592276:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175530.592279:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175530.592283:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c168eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bad expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.592293:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:2.0:1789175530.592478:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10288:x1876086251087488:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2089us (2988us total) trans 0 rc 301/301 00000100:00100000:2.0:1789175530.592487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1789175530.600241:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175530.600311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251087744 00000100:00100000:1.0:1789175530.600320:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251087744 00000100:00100000:1.0:1789175530.600404:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175530.600414:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10288:x1876086251087744:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:1.0:1789175530.600466:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175530.600490:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c168a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b98 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600505:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175530.600515:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175530.600716:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600726:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600733:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600740:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600752:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.600756:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175530.601569:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789175530.601581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601599:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601606:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601612:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175530.601616:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601624:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601634:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:1.0:1789175530.601637:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175530.601640:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.601644:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16900 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175530.601667:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c83715e3 reply state 00000000a7123652 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175530.601673:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789175530.601764:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:10288:x1876086251087744:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 1352us (1531us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789175530.601770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:0.0:1789175530.604369:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604386:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604404:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604410:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654bc00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175530.604416:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604423:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604440:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97e721b55100) 00010000:00010000:0.0:1789175530.604444:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175530.604448:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.604474:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16907 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175530.696650:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175530.699263:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251087872 00000100:00100000:3.0:1789175530.699281:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251087872 00000100:00100000:3.0:1789175530.699777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1789175530.699792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:10296:x1876086251087872:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:3.0:1789175530.699824:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175530.699853:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1690e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.699930:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.699948:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.699963:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175530.700006:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789175530.700010:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789175530.700052:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.700090:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1690e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bb4 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.700114:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bb4 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.700141:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:3.0:1789175530.700145:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789175530.700151:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8200, rc 0) 00000100:00100000:3.0:1789175530.700249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+10:10296:x1876086251087872:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 460us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175530.700257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1789175530.760163:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175530.760277:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088000 00000100:00100000:2.0:1789175530.760288:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088000 00000100:00100000:2.0:1789175530.760401:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1789175530.760413:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+10:10302:x1876086251088000:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175530.760434:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175530.760455:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c1691c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bbb expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760524:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760540:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760551:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760601:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760610:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760617:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760933:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760943:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.760950:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175530.760980:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789175530.760985:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175530.761023:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761036:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761043:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761050:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761065:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175530.761069:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761077:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761089:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:2.0:1789175530.761093:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175530.761097:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761103:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0a00/0x1112cdeac4c16923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761119:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761126:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761132:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761137:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175530.761139:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761145:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761162:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97e7181cd800) 00010000:00010000:2.0:1789175530.761165:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175530.761168:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761175:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1e00/0x1112cdeac4c1692a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761210:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a0800/0x1112cdeac4c1691c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bbb expref: 12 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761224:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bbb expref: 11 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.761230:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175530.761232:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789175530.761235:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4c00, rc 0) 00000100:00100000:2.0:1789175530.761629:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+11:10302:x1876086251088000:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1217us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.761638:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1789175530.766754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175530.767058:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088256 00000100:00100000:0.0:1789175530.767068:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088256 00000100:00100000:0.0:1789175530.767129:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:0.0:1789175530.767140:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+11:10302:x1876086251088256:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175530.767165:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175530.767189:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bc2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768477:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768503:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768526:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768605:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768613:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.768621:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175530.769218:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789175530.771861:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771883:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771895:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771935:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771942:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771949:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771954:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175530.771958:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771966:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.771978:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175530.771981:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175530.771986:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.772007:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c1693f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175530.772021:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fd04ec4 reply state 00000000d5b3bfc5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175530.772029:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789175530.772067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.772081:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.772089:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175530.772091:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175530.772094:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668e00, rc 0) 00000100:00100000:0.0:1789175530.772172:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10302:x1876086251088256:12345-192.168.201.18@tcp:101:bash.0 Request processed in 5033us (5429us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789175530.772181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:1.0:1789175530.774317:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774333:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774491:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774499:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175530.774503:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774512:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774694:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102eca00) 00010000:00010000:1.0:1789175530.774697:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175530.774703:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175530.774719:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16946 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175530.775327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175530.776149:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088384 00000100:00100000:0.0:1789175530.776159:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088384 00000100:00100000:0.0:1789175530.776236:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1789175530.776245:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251088384:12345-192.168.201.18@tcp:8:bash.0 00010000:00080000:0.0:1789175530.776278:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1789175530.776308:0:6686:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c1695b 00002000:00100000:0.0:1789175530.776320:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5b56eceb-e538-4909-8f73-c533ee4baa44/ffff97e710c1c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175530.776483:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175530.776737:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789175530.776770:0:6686:0:(import.c:65:import_set_state_nolock()) ffff97e710c1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175530.776836:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251088384:12345-192.168.201.18@tcp:8:bash.0 Request processed in 590us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175530.776844:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1789175530.778772:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175530.778874:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088512 00000100:00100000:2.0:1789175530.778882:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088512 00000100:00100000:2.0:1789175530.778950:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1789175530.778960:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:0:x1876086251088512:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175530.778974:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175530.778996:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bc9 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789175530.779040:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175530.779056:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1789175530.779061:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175530.779070:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.779091:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.779106:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4000, rc 0) 00000100:00100000:2.0:1789175530.779161:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:0:x1876086251088512:12345-192.168.201.18@tcp:101:bash.0 Request processed in 202us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.779168:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00080000:3.0:1789175530.779234:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175530.782630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175530.782967:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088640 00000100:00100000:0.0:1789175530.782976:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088640 00000100:00100000:0.0:1789175530.783026:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:0.0:1789175530.783036:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10302:x1876086251088640:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175530.783054:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175530.783076:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bd0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.783110:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.783118:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175530.783122:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175530.783128:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.783163:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175530.783194:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175530.783208:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876086274190080:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175530.783336:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e728c28600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175530.788077:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175530.788882:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876086274190080:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175530.788918:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175530.788940:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669600, rc 0) 00000100:00100000:2.0:1789175530.789041:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:10302:x1876086251088640:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6004us (6420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.789059:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1789175530.789242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251088768 00000100:00100000:3.0:1789175530.789248:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251088768 00010000:00010000:3.0:1789175530.789279:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175530.789315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1789175530.789324:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251088768:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175530.789336:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175530.789373:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.789395:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.789420:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c16962 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc9 expref: 8 pid: 6687 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.789453:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175530.789457:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175530.789465:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.789475:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.789506:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175530.789530:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274190208:192.168.201.18@tcp:105: 00000100:00100000:3.0:1789175530.789599:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7146d99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175530.797195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175530.797286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251089024 00000100:00100000:0.0:1789175530.797295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251089024 00000100:00100000:0.0:1789175530.797381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1789175530.797401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10302:x1876086251089024:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:0.0:1789175530.798060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10302:x1876086251089024:12345-192.168.201.18@tcp:35:bash.0 Request processed in 667us (873us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789175530.798069:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175530.804637:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274190208:192.168.201.18@tcp:105: 00010000:00010000:3.0:1789175530.804665:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175530.805452:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251088768:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 16121us (17377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.805466:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1789175530.913831:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274190464:0@lo:400:kworker.0 00000100:00100000:0.0:1789175530.913905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175530.913972:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175530.913979:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274190592:0@lo:400:kworker.0 00000100:00100000:0.0:1789175530.914003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175530.914053:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190464 00000100:00100000:0.0:1789175530.914061:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190464 00000100:00100000:0.0:1789175530.914117:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190592 00000100:00100000:0.0:1789175530.914180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190592 00000100:00100000:0.0:1789175530.914214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789175530.914221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274190464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175530.914312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274190464:12345-0@lo:400:kworker.0 Request processed in 91us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175530.914319:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789175530.914336:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789175530.914374:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274190592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175530.914526:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274190592:12345-0@lo:400:kworker.0 Request processed in 184us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175530.914533:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789175530.914577:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274190592:0@lo:400:kworker.0 00000100:00100000:0.0:1789175530.914599:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274190464:0@lo:400:kworker.0 00000100:00100000:1.0:1789175530.914822:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274190720:0@lo:400:kworker.0 00000100:00100000:1.0:1789175530.914857:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175530.914887:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789175530.914894:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274190336:0@lo:400:kworker.0 00000100:00100000:1.0:1789175530.914919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175530.914941:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274190848:0@lo:400:kworker.0 00000100:00100000:1.0:1789175530.914966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175530.914991:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190848 00000100:00100000:1.0:1789175530.914995:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190848 00000100:00100000:1.0:1789175530.915037:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175530.915044:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274190848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175530.915076:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274190848:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175530.915082:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789175530.915105:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274190848:0@lo:400:kworker.0 00000100:00100000:2.0:1789175530.915528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190336 00000100:00100000:2.0:1789175530.915533:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190336 00000100:00100000:2.0:1789175530.915563:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789175530.915571:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274190336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175530.915626:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3304:x1876086274190336:12345-0@lo:400:kworker.0 Request processed in 56us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.915632:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789175530.915669:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274190336:0@lo:400:kworker.0 00000100:00100000:2.0:1789175530.915691:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190720 00000100:00100000:2.0:1789175530.915694:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190720 00000100:00100000:0.0:1789175530.915745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175530.915757:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274190976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175530.915787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175530.915873:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789175530.915880:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274190720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175530.915918:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274190720:12345-0@lo:400:kworker.0 Request processed in 38us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.915924:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789175530.915944:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274190976 00000100:00100000:2.0:1789175530.915947:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274190976 00000100:00100000:2.0:1789175530.915970:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789175530.915976:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274190976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175530.915991:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175530.916041:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274190976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175530.916046:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789175530.916075:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274190720:0@lo:400:kworker.0 00000100:00080000:1.0:1789175530.917072:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175530.917093:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175530.919364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175530.920790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e726705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274190976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175530.920837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251089280 00000100:00100000:3.0:1789175530.920847:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251089280 00000100:00100000:3.0:1789175530.920960:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1789175530.920971:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10312:x1876086251089280:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175530.920995:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175530.921015:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175530.921150:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789175530.921280:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16970 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd7 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.921296:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:3.0:1789175530.921300:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175530.921306:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd7 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175530.921320:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9000, rc 0) 00000100:00100000:3.0:1789175530.921423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10312:x1876086251089280:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 454us (2067us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789175530.921430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1789175530.924957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175530.926107:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251089536 00000100:00100000:2.0:1789175530.926120:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251089536 00000100:00100000:2.0:1789175530.926191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1789175530.926199:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789175530.926204:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10312:x1876086251089536:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175530.926213:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789175530.926759:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+16:10312:x1876086251089536:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 556us (1810us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789175530.926768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00010000:00010000:1.0:1789175530.981151:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175531.042769:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.043057:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251089664 00000100:00100000:0.0:1789175531.043067:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251089664 00000100:00100000:0.0:1789175531.043127:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1789175531.043138:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:10318:x1876086251089664:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175531.043161:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.043181:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1697e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bde expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043272:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043288:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043301:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175531.043334:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789175531.043337:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175531.043378:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043403:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1697e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bde expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043420:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bde expref: 17 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.043429:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175531.043432:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175531.043435:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669800, rc 0) 00000100:00100000:0.0:1789175531.043495:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10318:x1876086251089664:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 357us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.043502:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1789175531.054455:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.055817:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251089920 00000100:00100000:0.0:1789175531.055830:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251089920 00000100:00100000:0.0:1789175531.055907:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1789175531.055918:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10318:x1876086251089920:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175531.055938:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.055960:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1698c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2be5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.056140:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.056155:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.056168:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175531.056180:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789175531.056303:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1698c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2be5 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.056320:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2be5 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.056329:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175531.056332:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175531.056335:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669e00, rc 0) 00000100:00100000:0.0:1789175531.056487:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10318:x1876086251089920:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 571us (2038us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789175531.056495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1789175531.063879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.063975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175531.064105:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090304 00000100:00100000:2.0:1789175531.064115:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090304 00000100:00100000:2.0:1789175531.064176:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1789175531.064186:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10318:x1876086251090304:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175531.064211:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175531.064232:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c169a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bec expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.064325:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.064364:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.064378:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175531.064390:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789175531.064506:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c169a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bec expref: 22 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.064536:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bec expref: 21 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.064553:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:2.0:1789175531.064556:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789175531.064569:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:2.0:1789175531.064646:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10318:x1876086251090304:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 461us (670us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789175531.064653:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1789175531.070241:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090048 00000100:00100000:3.0:1789175531.070258:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090048 00000100:00100000:0.0:1789175531.070567:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1789175531.070588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2354:x1876086251090048:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175531.070608:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175531.070635:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2be5 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.070653:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175531.070658:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175531.070736:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:2354:x1876086251090048:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 157us (6870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.070744:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1789175531.078090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175531.078177:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090432 00000100:00100000:2.0:1789175531.078187:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090432 00000100:00100000:2.0:1789175531.078246:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175531.078256:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2356:x1876086251090432:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:2.0:1789175531.078300:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.078321:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.078330:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789175531.078334:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175531.078368:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.078405:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.078419:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175531.078450:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e711040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876086274191104:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175531.078552:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70767e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175531.081163:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e711040000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1876086274191104:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175531.081192:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.084067:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175531.084294:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090560 00000100:00100000:2.0:1789175531.084306:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090560 00002000:00100000:2.0:1789175531.084385:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97e7071d7b80 x1876086251090560/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:702/0 lens 504/0 e 0 to 0 dl 1789175542 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789175531.084397:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7071d7b80 with x1876086251090560 ext(0->12) 00010000:00010000:2.0:1789175531.084406:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 8 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.084423:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 8 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789175531.084432:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e7071d7b80 00000100:00100000:2.0:1789175531.084460:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1789175531.084471:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251090560:12345-192.168.201.18@tcp:4:lfs.0 00000001:00100000:0.0:1789175531.113056:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000001:00080000:0.0:1789175531.152041:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789175531.152263:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251090560:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 67786us (68201us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789175531.152281:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:3.0:1789175531.152295:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97e7071d7b80 x1876086251090560/t4294967299(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:702/0 lens 504/448 e 0 to 0 dl 1789175542 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175531.152307:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7071d7b80 with x1876086251090560 ext(0->12) 00010000:00010000:3.0:1789175531.152318:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175531.152338:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175531.152377:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e7071d7b80 00000100:00100000:2.0:1789175531.156318:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175531.156424:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090688 00000100:00100000:1.0:1789175531.156434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090688 00010000:00010000:1.0:1789175531.156477:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.156674:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:1.0:1789175531.156698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2356:x1876086251090688:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175531.156724:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789175531.156743:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789175531.156746:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789175531 00002000:00010000:1.0:1789175531.156749:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789175531 00002000:00010000:1.0:1789175531.156751:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789175531 00002000:00010000:1.0:1789175531.156754:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789175531.156760:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.156775:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.156799:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d882cb11/0x1112cdeac4c16969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bd0 expref: 7 pid: 6686 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.156818:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175531.156823:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175531.156828:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.156838:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.156913:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175531.156974:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251090688:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 278us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175531.156990:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00010000:00010000:0.0:1789175531.158436:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158456:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158521:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158531:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158541:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158548:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175531.158554:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158693:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158783:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.158793:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a56455f/0x1112cdeac4c169b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.158957:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251090432:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 80697us (80871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.158967:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1789175531.163424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.163526:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251090944 00000100:00100000:0.0:1789175531.163538:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251090944 00000100:00100000:0.0:1789175531.163616:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1789175531.163627:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:10318:x1876086251090944:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1789175531.163690:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bec expref: 20 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175531.163999:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789175531.164067:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789175531.164647:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789175531.164704:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.164723:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.164732:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.164771:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.164787:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 24 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.164802:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876086274191232:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175531.164898:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175531.169072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175531.169160:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251091072 00000100:00100000:1.0:1789175531.169170:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251091072 00010000:00010000:1.0:1789175531.169213:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 25 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.169255:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175531.169265:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+25:2353:x1876086251091072:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175531.169281:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175531.169288:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 25 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.169301:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 25 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.169322:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175531.169328:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.169338:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.169372:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.169393:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175531.169458:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+25:2353:x1876086251091072:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 193us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175531.169482:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:0.0:1789175531.169660:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1694d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bc2 expref: 24 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.169691:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1876086274191232:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175531.169728:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.169738:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.169744:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175531.169866:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789175531.170091:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789175531.170199:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876086274191360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789175531.170296:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175531.170372:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175531.170606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274191360 00000100:00100000:1.0:1789175531.170611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274191360 00000100:00100000:1.0:1789175531.170642:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175531.170651:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876086274191360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789175531.170738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876086274191360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175531.170746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175531.171798:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876086274191360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789175531.172482:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789175531.172571:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876086274191488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789175531.172637:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175531.172669:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175531.173149:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274191488 00000100:00100000:2.0:1789175531.173157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274191488 00000100:00100000:2.0:1789175531.173213:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175531.173223:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876086274191488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789175531.173552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1876086274191488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 329us (913us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789175531.173561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175531.173689:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1876086274191488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789175531.173787:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789175531.173835:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173847:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173855:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173861:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175531.173865:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173874:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173892:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175531.173895:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789175531.173907:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.173914:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c169bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789175531.174121:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789175531.174402:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789175531.174415:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316133072900ns, next at 317133070099ns, rc = 0 00000001:00080000:1.0:1789175531.174421:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789175531.174456:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:1.0:1789175531.174460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789175531.174468:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c169a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bec expref: 28 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.174600:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10318:x1876086251090944:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 10974us (11185us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789175531.174608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000020:00080000:1.0:1789175531.174612:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789175531.179085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.179193:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251091200 00000100:00100000:0.0:1789175531.179206:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251091200 00000100:00100000:0.0:1789175531.179277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:0.0:1789175531.179289:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10318:x1876086251091200:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175531.179314:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.179366:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c169c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bf3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.179448:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c169c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bf3 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.179463:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c169c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bf3 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.179482:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175531.179485:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175531.179490:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668e00, rc 0) 00000100:00100000:0.0:1789175531.179570:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+28:10318:x1876086251091200:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 284us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.179586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1789175531.183093:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.183203:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251091456 00000100:00100000:0.0:1789175531.183214:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251091456 00000100:00100000:0.0:1789175531.183276:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175531.183285:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708382c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+28:10318:x1876086251091456:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175531.183765:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708382c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+29:10318:x1876086251091456:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 478us (679us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789175531.183773:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175531.305185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.305285:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251091712 00000100:00100000:0.0:1789175531.305295:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251091712 00000100:00100000:0.0:1789175531.305392:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1789175531.305403:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+29:10328:x1876086251091712:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175531.305429:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.305453:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c169cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2bfa expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175531.305573:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789175531.305713:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c169cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bfa expref: 31 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.305729:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:0.0:1789175531.305732:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175531.305738:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c169cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bfa expref: 31 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.305751:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175531.305811:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10328:x1876086251091712:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 410us (635us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789175531.305819:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:3.0:1789175531.309974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.310151:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251091840 00000100:00100000:0.0:1789175531.310162:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251091840 00000100:00100000:0.0:1789175531.310272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1789175531.310284:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10328:x1876086251091840:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1789175531.310374:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310391:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310402:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310419:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310441:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310448:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310552:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310571:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310587:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175531.310630:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310641:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310647:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310656:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310662:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175531.310666:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310673:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310693:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175531.310696:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175531.310712:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310718:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310732:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310738:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310743:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310748:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175531.310751:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310756:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310763:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102ec900) 00010000:00010000:0.0:1789175531.310765:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175531.310767:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310772:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310799:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310806:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310811:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310816:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175531.310819:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310825:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310832:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175531.310834:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175531.310837:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.310843:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.310924:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10328:x1876086251091840:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 641us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.310932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1789175531.315539:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175531.315857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251092096 00000100:00100000:1.0:1789175531.315868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251092096 00000100:00100000:1.0:1789175531.315932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1789175531.315942:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10328:x1876086251092096:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1789175531.316191:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+31:10328:x1876086251092096:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 249us (661us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789175531.316198:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175531.394990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.395389:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251092352 00000100:00100000:0.0:1789175531.395400:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251092352 00000100:00100000:0.0:1789175531.395464:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1789175531.395491:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+31:10331:x1876086251092352:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175531.395522:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.395545:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c01 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395824:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395844:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395858:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395874:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395882:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.395889:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396012:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396020:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396027:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175531.396056:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789175531.396144:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396152:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396159:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396165:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175531.396169:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396176:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396188:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175531.396191:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175531.396195:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396202:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c169f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396213:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396219:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396233:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.396239:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175531.396242:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397097:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397110:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102ec900) 00010000:00010000:0.0:1789175531.397113:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175531.397117:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397123:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c169fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397179:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c169ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 34 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397192:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 33 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.397199:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175531.397202:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175531.397204:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175531.397280:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10331:x1876086251092352:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1792us (2300us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789175531.397299:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1789175531.401472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175531.401684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251092480 00000100:00100000:1.0:1789175531.401693:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251092480 00000100:00100000:1.0:1789175531.401762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1789175531.401786:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10331:x1876086251092480:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1789175531.401856:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401874:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401887:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401913:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401921:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401928:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401935:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175531.401939:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401948:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401960:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175531.401963:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789175531.401968:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.401975:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.402062:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10331:x1876086251092480:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 279us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175531.402070:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1789175531.406432:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.406524:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251092736 00000100:00100000:0.0:1789175531.406533:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251092736 00000100:00100000:0.0:1789175531.406600:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175531.406610:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10331:x1876086251092736:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175531.406852:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+34:10331:x1876086251092736:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 242us (428us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789175531.406859:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1789175531.766167:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175531.766446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251092992 00000100:00100000:2.0:1789175531.766456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251092992 00000100:00100000:2.0:1789175531.766533:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:2.0:1789175531.766556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+34:10362:x1876086251092992:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1789175531.766589:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175531.766610:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c08 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.766711:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.766727:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.766740:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175531.766751:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789175531.766895:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c08 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.766913:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c08 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.766923:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175531.766927:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175531.766930:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5e00, rc 0) 00000100:00100000:2.0:1789175531.766994:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10362:x1876086251092992:12345-192.168.201.18@tcp:101:cat.0 Request processed in 451us (836us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789175531.767014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1789175531.779163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175531.779215:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.779385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251093376 00000100:00100000:0.0:1789175531.779396:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251093376 00000100:00100000:0.0:1789175531.779467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1789175531.779479:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707445c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+36:2354:x1876086251093376:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175531.779506:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175531.779534:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c08 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.779565:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175531.779594:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175531.779652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707445c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+35:2354:x1876086251093376:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 175us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175531.779660:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1789175531.779942:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251093248 00000100:00100000:2.0:1789175531.779947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251093248 00000100:00100000:2.0:1789175531.779985:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1789175531.779993:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+35:10362:x1876086251093248:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:2.0:1789175531.780213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10362:x1876086251093248:12345-192.168.201.18@tcp:35:cat.0 Request processed in 221us (1062us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789175531.780221:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1789175531.875589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.875746:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251093632 00000100:00100000:0.0:1789175531.875758:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251093632 00000100:00100000:0.0:1789175531.875826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1789175531.875839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10368:x1876086251093632:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1789175531.875885:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175531.875889:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789175531.875916:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bde expref: 36 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.875935:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175531.875941:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175531.875954:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c0f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.876050:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.876064:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 36 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.876073:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.876105:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 36 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.876120:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 36 pid: 8054 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.876136:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274191616:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175531.876224:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175531.884443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.884966:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274191616:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175531.885016:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.885157:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251093760 00000100:00100000:1.0:1789175531.885166:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251093760 00010000:00010000:1.0:1789175531.885206:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 37 pid: 8054 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175531.885250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1789175531.885260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+37:2354:x1876086251093760:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175531.885279:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175531.885286:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 37 pid: 8054 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885300:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 37 pid: 8054 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885323:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c01 expref: 37 pid: 8054 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885338:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175531.885381:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885394:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885414:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.885451:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175531.885647:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:2354:x1876086251093760:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 386us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175531.885656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00010000:00010000:2.0:1789175531.886332:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.886382:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175531.886404:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789175531.886905:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.886928:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175531.886939:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175531.886942:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175531.886946:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669400, rc 0) 00000100:00100000:2.0:1789175531.886999:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10368:x1876086251093632:12345-192.168.201.18@tcp:101:dd.0 Request processed in 11163us (11420us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789175531.887022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1789175531.890663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175531.890883:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094016 00000100:00100000:0.0:1789175531.890894:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094016 00000100:00100000:0.0:1789175531.890986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1789175531.890999:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10368:x1876086251094016:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:0.0:1789175531.891262:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.891283:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175531.891297:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175531.891447:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789175531.891482:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091fcc65b reply state 00000000eb1f3feb transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175531.891491:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175531.891944:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+39:10368:x1876086251094016:12345-192.168.201.18@tcp:36:dd.0 Request processed in 943us (1287us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789175531.891952:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000020:00080000:0.0:1789175531.891957:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789175531.897980:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.897997:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.898006:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.898013:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175531.898018:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.898027:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.898045:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175531.898048:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175531.898053:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175531.898060:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.001988:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175532.176100:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.176322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094144 00000100:00100000:0.0:1789175532.176334:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094144 00000100:00100000:0.0:1789175532.176455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00080000:1.0:1789175532.176457:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175532.176474:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+38:10382:x1876086251094144:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:0.0:1789175532.176503:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175532.176540:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176623:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176654:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176669:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176677:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176683:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176777:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176788:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176796:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176849:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.176873:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 39 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175532.176888:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274191744:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175532.176996:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1789175532.181437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175532.181916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094400 00000100:00100000:1.0:1789175532.181930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094400 00000100:00100000:1.0:1789175532.182009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175532.182022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+40:6054:x1876086251094400:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789175532.183165:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274191744:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175532.183282:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175532.183895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+41:6054:x1876086251094400:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 1871us (2469us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789175532.183908:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175532.187602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.187824:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094528 00000100:00100000:0.0:1789175532.187836:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094528 00010000:00010000:0.0:1789175532.187894:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 41 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175532.187983:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1789175532.187996:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+41:2354:x1876086251094528:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175532.188016:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175532.188023:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 41 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188056:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 41 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188083:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c0f expref: 41 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188104:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175532.188111:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188141:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188151:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.188199:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175532.188275:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+40:2354:x1876086251094528:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 282us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175532.188283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00010000:00010000:2.0:1789175532.188388:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188399:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175532.188464:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789175532.188470:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175532.188542:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188558:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188579:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188586:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188593:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188600:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.188615:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188624:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188635:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175532.188638:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.188642:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188649:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16a50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188662:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188668:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188674:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188679:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.188696:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188702:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188711:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102ec900) 00010000:00010000:2.0:1789175532.188713:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.188722:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188728:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16a57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188782:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16a49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c16 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188798:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c16 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.188806:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175532.188808:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175532.188811:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669800, rc 0) 00000100:00100000:2.0:1789175532.188848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+39:10382:x1876086251094144:12345-192.168.201.18@tcp:101:stat.0 Request processed in 12383us (12759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175532.188856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:2.0:1789175532.280090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.280265:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094784 00000100:00100000:0.0:1789175532.280280:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094784 00000100:00100000:0.0:1789175532.280390:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:0.0:1789175532.280402:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+39:10388:x1876086251094784:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:0.0:1789175532.280477:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175532.280511:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c16 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.280534:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175532.280539:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175532.280826:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.280844:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.280857:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175532.280935:0:8054:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789175532.280961:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b3150d7 reply state 000000006bc8327a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175532.280971:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175532.281883:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+41:10388:x1876086251094784:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 1474us (1800us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789175532.281896:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000020:00080000:0.0:1789175532.281903:0:8054:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175532.297680:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297774:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297783:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297790:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.297796:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297832:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297855:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175532.297858:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.297865:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.297871:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16a65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175532.473198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.473398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251094912 00000100:00100000:0.0:1789175532.473412:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251094912 00000100:00100000:0.0:1789175532.473499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:0.0:1789175532.473511:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+40:10402:x1876086251094912:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:0.0:1789175532.473543:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175532.473581:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c1d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473670:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473699:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473714:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473733:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473765:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473884:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473894:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.473901:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175532.473946:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789175532.473951:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175532.473984:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474000:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474009:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474017:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474024:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474405:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175532.474411:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474421:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474437:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175532.474440:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175532.474446:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474454:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16a73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474472:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474479:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474545:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474551:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175532.474554:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474569:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474590:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102ec500) 00010000:00010000:0.0:1789175532.474593:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175532.474596:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474603:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474665:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.474673:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175532.474774:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175532.474778:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669600, rc 0) 00000100:00100000:0.0:1789175532.475017:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+41:10402:x1876086251094912:12345-192.168.201.18@tcp:101:stat.0 Request processed in 1506us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175532.475028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1789175532.542038:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.542105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251095168 00000100:00100000:2.0:1789175532.542119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251095168 00000100:00100000:2.0:1789175532.542198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1789175532.542211:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+41:10412:x1876086251095168:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175532.542241:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175532.542270:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16a88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175532.542451:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789175532.542642:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16a88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c24 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.542661:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:2.0:1789175532.542664:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175532.542671:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16a88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c24 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.542710:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4600, rc 0) 00000100:00100000:2.0:1789175532.542790:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+42:10412:x1876086251095168:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 580us (766us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789175532.542799:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:1.0:1789175532.546746:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.547802:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251095424 00000100:00100000:2.0:1789175532.547821:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251095424 00000100:00100000:2.0:1789175532.547903:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1789175532.547915:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+42:10412:x1876086251095424:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175532.548235:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+43:10412:x1876086251095424:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 321us (2068us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789175532.548244:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1789175532.625756:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.626658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251095680 00000100:00100000:2.0:1789175532.626676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251095680 00000100:00100000:2.0:1789175532.626771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1789175532.626785:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+43:10418:x1876086251095680:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175532.626820:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175532.626850:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16a96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.626994:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.627013:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.627057:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.627102:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.627119:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 44 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175532.627136:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274191872:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175532.627269:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175532.636138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.637667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251095808 00000100:00100000:0.0:1789175532.637685:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251095808 00010000:00010000:0.0:1789175532.637760:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 45 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175532.637828:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:0.0:1789175532.637841:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+45:2355:x1876086251095808:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175532.637883:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175532.637891:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 45 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.637905:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 45 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.637932:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175532.637937:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.637947:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.637954:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.637974:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175532.638046:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+45:2355:x1876086251095808:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 207us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175532.638055:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:2.0:1789175532.640806:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16a81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c1d expref: 44 pid: 5838 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175532.640834:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734745c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274191872:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175532.640869:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.640878:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.640883:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175532.640905:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789175532.641222:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16a96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.641252:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.641260:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175532.641263:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175532.641266:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4e00, rc 0) 00000100:00100000:2.0:1789175532.641432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+44:10418:x1876086251095680:12345-192.168.201.18@tcp:101:bash.0 Request processed in 14649us (15691us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789175532.641442:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1789175532.646510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.648733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096064 00000100:00100000:2.0:1789175532.648758:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096064 00000100:00100000:2.0:1789175532.648844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:2.0:1789175532.648856:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+44:10418:x1876086251096064:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:2.0:1789175532.649394:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.649415:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.649427:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789175532.649475:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789175532.649500:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002381093b reply state 00000000e9fe9bef transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175532.649509:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175532.650419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+47:10418:x1876086251096064:12345-192.168.201.18@tcp:36:bash.0 Request processed in 1555us (3914us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789175532.650431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000020:00080000:2.0:1789175532.650437:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175532.655900:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.655928:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.655947:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.655953:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.655959:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.655968:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.656101:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175532.656105:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.656111:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.656119:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16aab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175532.662296:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.663534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096192 00000100:00100000:0.0:1789175532.663656:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096192 00000100:00100000:0.0:1789175532.663864:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1789175532.663878:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+46:10418:x1876086251096192:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175532.663916:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175532.663956:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16ab2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c32 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.664126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.664143:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.664153:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.664333:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175532.664373:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 47 pid: 5840 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175532.664390:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274192000:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175532.664518:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175532.668518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.668656:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274192000:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175532.668698:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175532.668780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096320 00000100:00100000:3.0:1789175532.668789:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096320 00010000:00010000:3.0:1789175532.668835:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 48 pid: 5840 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175532.668879:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1789175532.668889:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+48:2353:x1876086251096320:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175532.668907:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175532.668915:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 48 pid: 5840 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.668928:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 48 pid: 5840 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.668979:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16a9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c2b expref: 48 pid: 5840 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.669009:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:3.0:1789175532.669014:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.669026:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.669035:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.669068:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175532.669134:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+47:2353:x1876086251096320:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 246us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175532.669141:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00010000:00010000:1.0:1789175532.669710:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.669720:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175532.669783:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789175532.669789:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175532.669844:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.669889:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16ab2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c32 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.669922:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c32 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.669932:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175532.669935:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175532.670096:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669e00, rc 0) 00000100:00100000:1.0:1789175532.670152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+46:10418:x1876086251096192:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6277us (7869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175532.670161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:3.0:1789175532.674509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.674712:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096960 00000100:00100000:0.0:1789175532.674727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096960 00000100:00100000:0.0:1789175532.674805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175532.674817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708380850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+46:10418:x1876086251096960:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:0.0:1789175532.675153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708380850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+47:10418:x1876086251096960:12345-192.168.201.18@tcp:35:bash.0 Request processed in 337us (659us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789175532.675297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1789175532.675923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.675964:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.676012:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.676036:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096576 00000100:00100000:2.0:1789175532.676051:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096576 00000100:00100000:2.0:1789175532.676117:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1789175532.676128:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251096576:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175532.676195:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251096576:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175532.676203:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00080000:2.0:1789175532.676301:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175532.676572:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096704 00000100:00100000:3.0:1789175532.676578:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096704 00000100:00100000:3.0:1789175532.676625:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:3.0:1789175532.676633:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251096704:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175532.676672:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251096704:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175532.676678:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:0.0:1789175532.678122:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251096448 00000100:00100000:0.0:1789175532.678137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251096448 00000100:00100000:0.0:1789175532.678221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 284 00000100:00100000:0.0:1789175532.678231:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251096448:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175532.678303:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251096448:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175532.678311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 284 00000100:00080000:2.0:1789175532.679124:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175532.769991:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.771311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251097216 00000100:00100000:2.0:1789175532.771328:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251097216 00000100:00100000:2.0:1789175532.771493:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1789175532.771506:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+47:10428:x1876086251097216:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175532.772008:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175532.772048:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16ac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c39 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175532.772294:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789175532.772479:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16ac0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c39 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.772498:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:3.0:1789175532.772502:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175532.772507:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16ac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c39 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.772525:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9000, rc 0) 00000100:00100000:3.0:1789175532.772727:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10428:x1876086251097216:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1222us (2749us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789175532.772736:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1789175532.775244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.775416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251097344 00000100:00100000:2.0:1789175532.775428:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251097344 00000100:00100000:2.0:1789175532.775499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1789175532.775513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10428:x1876086251097344:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1789175532.775637:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.775659:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.775976:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776001:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776009:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776048:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776472:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776494:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.776504:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175532.777019:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777310:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777319:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777328:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777335:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.777960:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777972:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.777991:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175532.778014:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.778021:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778039:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16ace lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778061:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778077:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778083:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778089:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.778093:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778099:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778107:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7181cd000) 00010000:00010000:2.0:1789175532.778110:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.778114:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778119:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778140:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778155:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778161:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778166:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175532.778170:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778177:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778187:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:2.0:1789175532.778189:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175532.778193:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175532.778199:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175532.779189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10428:x1876086251097344:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 3672us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175532.779205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1789175532.785959:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175532.786186:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251097600 00000100:00100000:2.0:1789175532.786203:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251097600 00000100:00100000:2.0:1789175532.786291:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1789175532.786304:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10428:x1876086251097600:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175532.786796:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+49:10428:x1876086251097600:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 492us (851us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789175532.786807:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1789175532.831203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175532.831333:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251097856 00000100:00100000:3.0:1789175532.831379:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251097856 00000100:00100000:3.0:1789175532.831471:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1789175532.831562:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+49:10431:x1876086251097856:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175532.831594:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175532.831638:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c40 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831815:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831834:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831849:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831867:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831875:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.831882:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832027:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832038:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832423:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175532.832547:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789175532.832924:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832944:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832951:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832957:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175532.832962:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832970:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832983:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175532.832987:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175532.832993:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.832999:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16aea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833016:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833022:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833028:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833033:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175532.833041:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833236:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833244:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051dbb00) 00010000:00010000:3.0:1789175532.833247:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175532.833250:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833256:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833319:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c40 expref: 52 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833336:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c40 expref: 51 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.833470:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:3.0:1789175532.833473:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175532.833476:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8e00, rc 0) 00000100:00100000:3.0:1789175532.833622:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10431:x1876086251097856:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2137us (2432us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789175532.833636:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1789175532.837063:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175532.837802:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251097984 00000100:00100000:0.0:1789175532.837816:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251097984 00000100:00100000:1.0:1789175532.837964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:1.0:1789175532.837977:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10431:x1876086251097984:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1789175532.838085:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838109:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838124:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838159:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838166:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838173:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838197:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175532.838202:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838210:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838225:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175532.838228:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789175532.838234:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.838240:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175532.838368:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10431:x1876086251097984:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 364us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175532.838378:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1789175532.841071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175532.841467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251098240 00000100:00100000:3.0:1789175532.841489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251098240 00000100:00100000:3.0:1789175532.841567:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1789175532.841580:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10431:x1876086251098240:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175532.841922:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+52:10431:x1876086251098240:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 344us (878us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789175532.841932:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1789175532.845113:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175532.845259:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251098368 00000100:00100000:1.0:1789175532.845272:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251098368 00000100:00100000:1.0:1789175532.845396:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1789175532.845408:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+52:2353:x1876086251098368:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175532.845428:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175532.845461:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c40 expref: 52 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175532.845485:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175532.845492:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175532.845583:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+51:2353:x1876086251098368:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 177us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175532.845592:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1789175532.991172:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175532.992281:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251098624 00000100:00100000:3.0:1789175532.992298:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251098624 00000100:00100000:3.0:1789175532.992762:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1789175532.992776:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10449:x1876086251098624:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1789175532.992809:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175532.992836:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c47 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.992978:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.992996:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.993011:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175532.993025:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789175532.994027:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c47 expref: 54 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.994291:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c47 expref: 53 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175532.994304:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:3.0:1789175532.994319:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789175532.994324:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8800, rc 0) 00000100:00100000:3.0:1789175532.994438:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+53:10449:x1876086251098624:12345-192.168.201.18@tcp:101:cat.0 Request processed in 1664us (3280us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789175532.994449:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00010000:00010000:1.0:1789175533.027970:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175533.035800:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.036542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251098752 00000100:00100000:1.0:1789175533.036569:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251098752 00000100:00100000:1.0:1789175533.036657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:1.0:1789175533.036677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+53:10450:x1876086251098752:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175533.036710:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175533.036741:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c4e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036825:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036839:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036851:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175533.036900:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789175533.036905:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175533.036925:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036950:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c4e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036967:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c4e expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.036990:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175533.036993:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175533.036997:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175533.037064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+54:10450:x1876086251098752:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 399us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.037069:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000001:00080000:1.0:1789175533.040998:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000020:00080000:1.0:1789175533.041038:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e7070ff300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789175533.041046:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e707602400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e7070ff840 00000020:00080000:1.0:1789175533.041049:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e707602500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e734343800 00000004:00080000:1.0:1789175533.041105:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789175533.041134:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000001:00080000:1.0:1789175533.041160:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000020:00080000:2.0:1789175533.041518:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789175533.043091:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789175533.043274:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274192128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789175533.043402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175533.043774:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274192128 00000100:00100000:1.0:1789175533.043788:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274192128 00000100:00100000:1.0:1789175533.043885:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789175533.043898:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274192128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789175533.043938:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:2.0:1789175533.043961:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789175533.043994:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4a6eb, atime: 0x6aa4a6eb, ctime: 0x6aa4a6eb, blocks: 0xb 00010000:00010000:1.0:1789175533.044005:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.044026:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789175533.044031:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.044040:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.044077:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.044090:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.044098:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.044123:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175533.044156:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175533.044166:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.044177:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175533.044182:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.044194:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.044217:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.044226:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c16b30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.044682:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175533.044686:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175533.044689:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175533.044857:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876086274192128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 959us (1452us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789175533.044869:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1789175533.044908:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e734376a00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789175533.044917:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274192128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789175533.048574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.048746:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099136 00000100:00100000:1.0:1789175533.048759:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099136 00000100:00100000:1.0:1789175533.048879:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1789175533.048891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10450:x1876086251099136:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1789175533.049408:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10450:x1876086251099136:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 517us (873us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789175533.049418:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175533.054050:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.054288:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099264 00000100:00100000:3.0:1789175533.054301:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099264 00000100:00100000:3.0:1789175533.054412:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1789175533.054422:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10450:x1876086251099264:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:3.0:1789175533.054440:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789175533.054472:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ab9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c32 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.054492:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c47 expref: 14 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.054502:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c169c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bf3 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.054510:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:3.0:1789175533.054524:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175533.054617:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10450:x1876086251099264:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 195us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.054625:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1789175533.057904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.057976:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099392 00000100:00100000:3.0:1789175533.057996:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099392 00000100:00100000:3.0:1789175533.058075:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:3.0:1789175533.058088:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10450:x1876086251099392:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:3.0:1789175533.058270:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.058288:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.058299:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789175533.059081:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175533.059308:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789175533.059434:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789175533.059585:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10450:x1876086251099392:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1490us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.059597:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1789175533.095175:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175533.097562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099520 00000100:00100000:2.0:1789175533.097582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099520 00000100:00100000:3.0:1789175533.097868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1789175533.097884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10452:x1876086251099520:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175533.097912:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175533.097943:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098177:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098197:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098210:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098242:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098251:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098258:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098892:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098907:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.098916:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175533.098971:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789175533.098976:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789175533.099106:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099122:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099132:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099140:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099162:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099169:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175533.099175:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099184:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099198:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175533.099201:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175533.099207:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099213:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16b45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099228:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099234:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099241:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099247:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175533.099249:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099267:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099277:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051dbb00) 00010000:00010000:3.0:1789175533.099279:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175533.099283:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099288:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16b4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099334:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099407:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.099414:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175533.099416:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789175533.099419:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8000, rc 0) 00000100:00100000:3.0:1789175533.099522:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10452:x1876086251099520:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1631us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.099531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000040:00080000:1.0:1789175533.217626:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175533.217643:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175533.217739:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789175533.217750:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175533.217955:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734375180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274192256:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175533.218114:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73950a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789175533.226816:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734375180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274192256:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175533.227323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.227498:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099648 00000100:00100000:3.0:1789175533.227510:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099648 00000100:00100000:3.0:1789175533.227598:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1789175533.227610:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099648:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789175533.227764:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099648:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 154us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.227773:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1789175533.230121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.230230:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099776 00000100:00100000:0.0:1789175533.230242:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099776 00000100:00100000:0.0:1789175533.230316:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:0.0:1789175533.230329:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099776:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789175533.230392:0:8054:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789175533.230553:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099776:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 217us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175533.230562:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:1.0:1789175533.260618:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.269796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251099904 00000100:00100000:0.0:1789175533.269817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251099904 00000100:00100000:1.0:1789175533.269989:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1789175533.270019:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099904:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.270124:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270148:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270164:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270184:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270198:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270236:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270245:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270252:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175533.270323:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789175533.270328:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175533.270368:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270383:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270391:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270399:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270406:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175533.270411:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270420:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270436:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:1.0:1789175533.270440:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175533.270445:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270453:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16b5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270468:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270485:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270491:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270497:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175533.270501:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270508:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270515:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97e721b55500) 00010000:00010000:1.0:1789175533.270518:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175533.270520:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270526:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16b61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270556:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270564:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270570:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270575:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175533.270584:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270591:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270600:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175533.270603:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175533.270606:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.270613:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.270739:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251099904:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 721us (10134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.270749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:3.0:1789175533.276597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.276737:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251100160 00000100:00100000:0.0:1789175533.276751:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251100160 00000100:00100000:0.0:1789175533.276834:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:0.0:1789175533.276847:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251100160:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.276875:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175533.276902:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c16b6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c5c expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277047:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277067:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277083:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175533.277097:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789175533.277237:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277246:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277255:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277283:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175533.277289:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277298:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277314:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:0.0:1789175533.277317:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175533.277322:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277329:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277429:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c16b6f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c5c expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277454:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:0.0:1789175533.277456:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175533.277461:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c16b6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c5c expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.277472:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669000, rc 0) 00000100:00100000:0.0:1789175533.277565:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100160:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 719us (983us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789175533.277574:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:3.0:1789175533.283569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.284108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251100288 00000100:00100000:1.0:1789175533.284123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251100288 00000100:00100000:1.0:1789175533.284431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1789175533.284445:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100288:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789175533.284506:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789175533.284686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100288:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 244us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.284694:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:2.0:1789175533.300697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.300865:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251100544 00000100:00100000:0.0:1789175533.300888:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251100544 00000100:00100000:0.0:1789175533.300964:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1789175533.300987:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.301015:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175533.301019:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789175533.301061:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16b29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c4e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.301084:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175533.301091:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175533.301109:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c16b84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c63 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789175533.308959:0:8054:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789175533.311962:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.312584:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.312610:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.313097:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c16b84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c63 expref: 16 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.313205:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c63 expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.313219:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55500) 00010000:00010000:1.0:1789175533.313222:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175533.313227:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:1.0:1789175533.313447:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251100544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 12461us (12762us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789175533.313457:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1789175533.333857:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.334030:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251100800 00000100:00100000:0.0:1789175533.334044:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251100800 00000100:00100000:0.0:1789175533.334122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1789175533.334145:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251100800:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.334223:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175533.334257:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16b8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c63 expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334280:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55500) 00010000:00010000:0.0:1789175533.334298:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175533.334330:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334393:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334420:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334437:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334445:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334452:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334736:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334745:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334752:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334759:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175533.334764:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334774:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334784:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175533.334787:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175533.334792:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334805:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c16b99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334816:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334822:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334827:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334832:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175533.334835:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334842:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334849:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc68357bd (ffff97e7102ec500) 00010000:00010000:0.0:1789175533.334852:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175533.334855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.334861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16ba0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc68357bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.334964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100800:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 820us (1120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175533.334973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:2.0:1789175533.350397:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.350520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251100928 00000100:00100000:1.0:1789175533.350533:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251100928 00000100:00100000:1.0:1789175533.350614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:1.0:1789175533.350626:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251100928:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.350653:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175533.350690:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c6a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350736:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350752:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350774:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350897:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350921:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.350931:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.350934:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789175533.350939:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a200, rc 0) 00000100:00100000:1.0:1789175533.351029:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251100928:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 404us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.351036:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:1.0:1789175533.355942:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.356014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251101184 00000100:00100000:0.0:1789175533.356029:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251101184 00000100:00100000:0.0:1789175533.356158:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1789175533.356171:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251101184:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.356289:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.356323:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.356366:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175533.356780:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789175533.356793:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318315451590ns, next at 319315448933ns, rc = 0 00000004:00010000:0.0:1789175533.356915:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005578f864 reply state 00000000291bba9c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.356927:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175533.357558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10464:x1876086251101184:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1374us (1614us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789175533.357570:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:3.0:1789175533.360021:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1789175533.360094:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360110:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360118:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360125:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175533.360132:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360159:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360180:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.360184:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789175533.360191:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.360198:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c16bb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.360269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251101312 00000100:00100000:0.0:1789175533.360282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251101312 00000100:00100000:3.0:1789175533.360380:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:3.0:1789175533.360395:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:10464:x1876086251101312:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175533.360424:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175533.360446:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c71 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.360531:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 17 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.360557:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 17 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.360577:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175533.360580:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175533.360583:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8800, rc 0) 00000100:00100000:3.0:1789175533.360652:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10464:x1876086251101312:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 261us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.360659:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1789175533.363729:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.363812:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251101440 00000100:00100000:1.0:1789175533.363825:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251101440 00000100:00100000:1.0:1789175533.363916:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1789175533.363929:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876086251101440:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789175533.364113:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:1.0:1789175533.364156:0:6685:0:(genops.c:1385:class_connect()) connect: client 5b56eceb-e538-4909-8f73-c533ee4baa44, cookie 0x1112cdeac4c16bc3 00002000:00100000:1.0:1789175533.364171:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b56eceb-e538-4909-8f73-c533ee4baa44/ffff97e73474b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789175533.364200:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789175533.364564:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789175533.364605:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e73474a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175533.364697:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2352:x1876086251101440:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 Request processed in 770us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.364708:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1789175533.374920:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175533.375072:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251101568 00000100:00100000:2.0:1789175533.375087:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251101568 00000100:00100000:2.0:1789175533.375312:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00080000:1.0:1789175533.375323:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175533.375330:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:0:x1876086251101568:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000001:00100000:3.0:1789175533.448028:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000001:00080000:3.0:1789175533.448056:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789175533.448161:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:0:x1876086251101568:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 72831us (73250us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789175533.448186:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1789175533.451846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.452795:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251101824 00000100:00100000:0.0:1789175533.452811:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251101824 00000100:00100000:0.0:1789175533.452879:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1789175533.452892:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10464:x1876086251101824:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789175533.453154:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10464:x1876086251101824:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 265us (1323us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789175533.453163:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1789175533.464068:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.464227:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102080 00000100:00100000:1.0:1789175533.464236:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102080 00000100:00100000:1.0:1789175533.464421:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:1.0:1789175533.464431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10464:x1876086251102080:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789175533.464578:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10464:x1876086251102080:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 149us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.464584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:3.0:1789175533.473937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.474081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102208 00000100:00100000:0.0:1789175533.474091:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102208 00000100:00100000:0.0:1789175533.474156:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:0.0:1789175533.474166:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10464:x1876086251102208:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.474187:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175533.474210:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c78 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474286:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474304:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474319:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175533.474399:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175533.474423:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c78 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474472:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c78 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.474499:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175533.474502:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789175533.474506:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668a00, rc 0) 00000100:00100000:0.0:1789175533.474579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10464:x1876086251102208:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 414us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175533.474587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1789175533.480043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.480134:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102336 00000100:00100000:0.0:1789175533.480145:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102336 00000100:00100000:0.0:1789175533.480214:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1789175533.480228:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2356:x1876086251102336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.480251:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175533.480279:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c7f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175533.480310:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a6ed, blocks: 0x1 00010000:00010000:0.0:1789175533.480330:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:0.0:1789175533.480334:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175533.480383:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.480407:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.480421:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669a00, rc 0) 00000100:00100000:0.0:1789175533.480496:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2356:x1876086251102336:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 272us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175533.480504:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1789175533.488269:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.488401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102592 00000100:00100000:3.0:1789175533.488412:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102592 00000100:00100000:3.0:1789175533.488466:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:3.0:1789175533.488476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10464:x1876086251102592:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789175533.488838:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10464:x1876086251102592:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 188us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.488846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1789175533.496905:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.497108:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102720 00000100:00100000:1.0:1789175533.497126:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102720 00000100:00100000:1.0:1789175533.497245:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1789175533.497259:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:10464:x1876086251102720:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.497282:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175533.497307:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c86 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.497391:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.497403:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.497408:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.497415:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.497523:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.497555:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 7 pid: 6685 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.497572:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274192384:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175533.497681:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030780 going to sleep for 11 seconds 00000100:00100000:2.0:1789175533.509462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.509565:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102848 00000100:00100000:1.0:1789175533.509592:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102848 00010000:00010000:1.0:1789175533.509648:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 8 pid: 6685 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.510376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1789175533.510394:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251102848:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175533.510416:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175533.510448:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 8 pid: 6685 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.510468:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 8 pid: 6685 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.510500:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.510505:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.510516:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.510528:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.510589:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.510606:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1876086274192512:192.168.201.18@tcp:105: 00000100:00100000:1.0:1789175533.511460:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7396199c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789175533.511551:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069360883/0x1112cdeac4c16bd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c7f expref: 8 pid: 6685 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.511569:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274192384:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175533.511603:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.511620:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175533.513577:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10464:x1876086251102720:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 14407us (14768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.513592:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1789175533.526957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.527052:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251102976 00000100:00100000:0.0:1789175533.527070:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251102976 00002000:00100000:0.0:1789175533.527125:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97e72e458380 x1876086251102976/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:704/0 lens 504/0 e 0 to 0 dl 1789175544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175533.527137:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e458380 with x1876086251102976 ext(0->8) 00002000:00010000:0.0:1789175533.527142:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72e458380 00000100:00100000:0.0:1789175533.527188:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1789175533.527197:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251102976:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789175533.527963:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1876086274192512:192.168.201.18@tcp:105: 00010000:00010000:2.0:1789175533.528005:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175533.528079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707445450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251102848:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 17691us (18627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175533.528092:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1789175533.533311:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251102976:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 6106us (6358us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789175533.533327:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:0.0:1789175533.533368:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97e72e458380 x1876086251102976/t4294967302(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:704/0 lens 504/448 e 0 to 0 dl 1789175544 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175533.533387:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e458380 with x1876086251102976 ext(0->8) 00002000:00010000:0.0:1789175533.533394:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72e458380 00000100:00100000:1.0:1789175533.540033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.540143:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251103104 00000100:00100000:0.0:1789175533.540154:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251103104 00000100:00100000:0.0:1789175533.540217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:0.0:1789175533.540227:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10464:x1876086251103104:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789175533.642898:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789175533.642922:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789175533.642953:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789175533.643110:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789175533.643123:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789175533.643145:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274192640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789175533.643245:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175533.643376:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274192640 00000100:00100000:1.0:1789175533.643385:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274192640 00000100:00100000:1.0:1789175533.643454:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789175533.643461:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274192640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789175533.643688:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789175533.643692:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789175533 00002000:00010000:1.0:1789175533.643707:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789175533.643709:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789175533 -> 1789175533 00002000:00010000:1.0:1789175533.643712:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789175533.643781:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274192640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 318us (537us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789175533.643790:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789175533.643815:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789175533.644040:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e72e45b800/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789175533.644049:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274192640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789175533.644729:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251103104:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 104497us (104700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.644739:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:1.0:1789175533.653508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.653607:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251103232 00000100:00100000:3.0:1789175533.653623:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251103232 00000100:00100000:3.0:1789175533.654330:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1789175533.654378:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251103232:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789175533.683840:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251103232:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 29491us (30338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.683854:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000001:00080000:3.0:1789175533.683892:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1789175533.683908:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789175533.689016:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.690274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251103488 00000100:00100000:1.0:1789175533.690287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251103488 00000100:00100000:1.0:1789175533.690371:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:1.0:1789175533.690382:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251103488:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.690440:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175533.690562:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c78 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.690583:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.690588:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175533.690620:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.690635:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.690645:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175533.690929:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de8b83bd reply state 0000000056949931 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.690938:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789175533.691047:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10464:x1876086251103488:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 667us (2041us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789175533.691056:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:1.0:1789175533.695749:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1789175533.695783:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695798:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695806:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695812:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175533.695818:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695826:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695846:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.695850:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175533.695854:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.695861:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16be6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.695904:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251103616 00000100:00100000:1.0:1789175533.695913:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251103616 00000100:00100000:1.0:1789175533.695961:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1789175533.695971:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251103616:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789175533.696236:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789175533.696239:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789175533 -> 1789175533 00002000:00010000:1.0:1789175533.696241:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789175531 00002000:00010000:1.0:1789175533.696243:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789175533 -> 1789175533 00002000:00010000:1.0:1789175533.696245:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789175533.696306:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251103616:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 336us (566us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789175533.696314:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1789175533.707150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.707229:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251103872 00000100:00100000:1.0:1789175533.707239:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251103872 00000100:00100000:1.0:1789175533.707308:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:1.0:1789175533.707319:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10464:x1876086251103872:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.707411:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.707431:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.707442:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.707476:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.707499:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 13 pid: 5840 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.707514:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274192768:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175533.707618:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73bef9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175533.715218:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274192768:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175533.715255:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175533.715555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.715699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104000 00000100:00100000:1.0:1789175533.715708:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104000 00010000:00010000:1.0:1789175533.715744:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 14 pid: 5840 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.715786:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:1.0:1789175533.715795:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2354:x1876086251104000:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175533.715810:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175533.715817:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 14 pid: 5840 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715831:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 14 pid: 5840 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715853:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16bae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c6a expref: 14 pid: 5840 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715889:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.715893:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715903:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715912:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.715948:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175533.716007:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:2354:x1876086251104000:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.716015:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00010000:00010000:3.0:1789175533.717487:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717503:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717557:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717566:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717572:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717578:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175533.717582:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717589:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717604:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175533.717608:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789175533.717612:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.717620:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16bed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175533.717706:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10464:x1876086251103872:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 10386us (10564us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789175533.717716:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1789175533.726083:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.726132:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104128 00000100:00100000:1.0:1789175533.726143:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104128 00000100:00100000:1.0:1789175533.726204:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1789175533.726215:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251104128:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789175533.726259:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.726283:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.726292:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175533.726296:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175533.726301:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.726372:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.726386:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 7 pid: 6686 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.726401:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274192896:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175533.726492:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73bef9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175533.730028:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274192896:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175533.730059:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.732945:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175533.733128:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104256 00000100:00100000:3.0:1789175533.733138:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104256 00010000:00010000:3.0:1789175533.733186:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175533.733273:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1789175533.733283:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251104256:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175533.733298:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175533.733319:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.733332:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.733380:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c16bdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c86 expref: 8 pid: 6686 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.733394:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175533.733399:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175533.733405:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.733415:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175533.733438:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175533.733500:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251104256:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 218us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175533.733508:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00010000:00010000:1.0:1789175533.733574:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733584:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733608:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733616:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733635:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733641:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175533.733646:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733655:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733667:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.733674:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c16bf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.733722:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251104128:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 7509us (7650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.733730:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:3.0:1789175533.745649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.745800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104512 00000100:00100000:0.0:1789175533.745812:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104512 00000100:00100000:0.0:1789175533.745868:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:0.0:1789175533.745877:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+12:10464:x1876086251104512:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789175533.745956:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.745978:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.745991:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.746183:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.746194:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 13 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.746203:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.746251:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 13 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.746265:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 13 pid: 8054 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.746279:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193024:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175533.746376:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e734030b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175533.749505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.749597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104640 00000100:00100000:1.0:1789175533.749609:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104640 00010000:00010000:1.0:1789175533.749654:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 14 pid: 8054 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.749694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1789175533.749718:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2353:x1876086251104640:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175533.749736:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175533.749744:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 14 pid: 8054 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.749757:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 14 pid: 8054 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.749778:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175533.749784:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.749794:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.749803:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.749823:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175533.749877:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2353:x1876086251104640:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 160us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.749884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00010000:00010000:0.0:1789175533.750587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16bbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c71 expref: 13 pid: 8054 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175533.750604:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193024:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175533.750625:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.750634:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.750640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175533.750945:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789175533.751499:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789175533.751570:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789175533.753015:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274193152:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175533.753126:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175533.753172:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7340300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175533.753195:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274193152 00000100:00100000:1.0:1789175533.753203:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274193152 00000100:00100000:1.0:1789175533.753255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175533.753265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274193152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789175533.753381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274193152:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.753389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789175533.753419:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789175533.753426:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e72e45b800, transno 4294967303 00000100:00100000:3.0:1789175533.753448:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274193152:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789175533.754140:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789175533.754224:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274193280:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789175533.754273:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175533.754299:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175533.754384:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274193280 00000100:00100000:0.0:1789175533.754390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274193280 00000100:00100000:0.0:1789175533.754428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175533.754436:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274193280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175533.755009:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1876086274193280:12345-0@lo:1000:mdt00_001.0 Request processed in 572us (734us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789175533.755018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175533.755371:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274193280:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789175533.755410:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.755421:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.755430:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.755436:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175533.755441:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756782:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756804:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175533.756807:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175533.756813:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756820:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c16c02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756854:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756861:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756868:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756873:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175533.756876:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756882:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756890:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175533.756892:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175533.756895:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756909:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16b37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756952:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756967:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.756976:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.757011:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.757027:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 16 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175533.757040:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193408:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175533.757130:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175533.762325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175533.762552:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251104768 00000100:00100000:1.0:1789175533.762563:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251104768 00010000:00010000:1.0:1789175533.762603:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 17 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175533.762639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1789175533.762649:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+17:2354:x1876086251104768:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175533.762667:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175533.762673:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 17 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.762686:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 17 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.762708:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175533.762714:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.762724:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.762732:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175533.762751:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175533.762813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+17:2354:x1876086251104768:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 165us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175533.762820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00010000:00010000:2.0:1789175533.766103:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c55 expref: 16 pid: 5838 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175533.766126:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193408:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175533.766153:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766164:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766178:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766192:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766199:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766206:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766212:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175533.766216:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766223:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766239:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175533.766241:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175533.766246:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766252:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c16c09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766263:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766270:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766281:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766287:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175533.766290:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766296:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766304:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175533.766307:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175533.766310:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.766316:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16bfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175533.767998:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251104512:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 22109us (22348us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789175533.768011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000020:00080000:2.0:1789175533.768018:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789175533.768203:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789175533.768208:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175533.768235:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789175533.768240:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175533.771512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175533.771604:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251105024 00000100:00100000:0.0:1789175533.771615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251105024 00000100:00100000:0.0:1789175533.771912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1789175533.771924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10464:x1876086251105024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789175533.772648:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789175533.773951:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789175533.774025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.774042:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.774999:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.775011:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.775018:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.775030:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175533.775157:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789175533.775284:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10464:x1876086251105024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 3357us (3776us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789175533.775296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000020:00080000:0.0:1789175533.775302:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175533.778370:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175533.778383:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.778394:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175533.778399:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.778423:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.778442:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97e7102ecb00) 00010000:00010000:2.0:1789175533.778445:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789175533.778450:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.778457:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c16c10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175533.778484:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175533.778486:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175533.778487:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175534.049849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789175534.100772:0:11999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789175534.100783:0:11999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789175534.100819:0:11999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789175534.100826:0:11999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175534.314623:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175534.316490:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251105280 00000100:00100000:2.0:1789175534.316504:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251105280 00000100:00100000:2.0:1789175534.316583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:2.0:1789175534.316596:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+17:10474:x1876086251105280:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175534.316621:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175534.316642:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c8d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.316802:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c16c1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.316817:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c16c1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.316829:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c16c1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175534.316847:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789175534.317049:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c8d expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.317067:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c16c1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c8d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.317075:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175534.317079:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175534.317083:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5400, rc 0) 00000100:00100000:2.0:1789175534.317150:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10474:x1876086251105280:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 558us (2539us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789175534.317158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00080000:2.0:1789175534.317182:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175534.329046:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.329207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251105408 00000100:00100000:1.0:1789175534.329230:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251105408 00000100:00100000:1.0:1789175534.329458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1789175534.329470:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10474:x1876086251105408:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1789175534.329557:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329574:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329586:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329602:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329609:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329616:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329868:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329877:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329885:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175534.329934:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329957:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329962:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329968:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329973:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.329977:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329983:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.329995:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175534.329998:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.330003:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330009:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16c2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330018:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330024:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330029:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330038:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654bc00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.330041:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330046:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330054:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e721b55b00) 00010000:00010000:1.0:1789175534.330056:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.330058:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330078:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330085:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330090:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330095:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.330097:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330104:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330120:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175534.330123:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.330126:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.330132:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16c3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175534.330218:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10474:x1876086251105408:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 749us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175534.330228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:2.0:1789175534.420181:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175534.420501:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251105664 00000100:00100000:0.0:1789175534.420529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251105664 00000100:00100000:0.0:1789175534.420595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1789175534.420606:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10477:x1876086251105664:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175534.420626:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175534.420648:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16c41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420731:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420747:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420760:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420776:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420815:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.420821:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421100:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421108:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421115:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175534.421124:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789175534.421216:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421224:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421231:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421237:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175534.421241:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421248:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421270:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:0.0:1789175534.421272:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175534.421277:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421901:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c16c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421921:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421927:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421934:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421939:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175534.421942:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421949:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421959:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7102ece00) 00010000:00010000:0.0:1789175534.421962:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175534.421965:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.421972:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.422238:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c16c41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.422256:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.422264:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:3.0:1789175534.422266:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175534.422269:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668a00, rc 0) 00000100:00100000:3.0:1789175534.422653:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10477:x1876086251105664:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2047us (2480us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789175534.422662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1789175534.431992:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175534.432115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251105792 00000100:00100000:2.0:1789175534.432125:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251105792 00000100:00100000:2.0:1789175534.432221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:2.0:1789175534.432241:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10477:x1876086251105792:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1789175534.432753:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432772:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432784:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432845:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432852:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432860:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432867:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175534.432871:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432879:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432891:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:2.0:1789175534.432894:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175534.432899:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.432905:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175534.432989:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10477:x1876086251105792:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 756us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175534.432996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1789175534.435414:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.435615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106048 00000100:00100000:3.0:1789175534.435624:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106048 00000100:00100000:3.0:1789175534.435695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1789175534.435705:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708380450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10477:x1876086251106048:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175534.436399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708380450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:10477:x1876086251106048:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 692us (989us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789175534.436408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1789175534.486484:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175534.486978:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106304 00000100:00100000:2.0:1789175534.486989:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106304 00000100:00100000:2.0:1789175534.487051:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:2.0:1789175534.487077:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+22:10005:x1876086251106304:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175534.487106:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175534.487128:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2c9b expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.487235:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.487251:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.487259:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.487292:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.487305:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 23 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175534.487330:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274193536:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175534.487474:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175534.493131:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.493258:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106432 00000100:00100000:1.0:1789175534.493267:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106432 00010000:00010000:1.0:1789175534.493313:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 24 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175534.493402:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1789175534.493413:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:2354:x1876086251106432:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175534.493430:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175534.493436:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 24 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.493451:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 24 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.493473:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:1.0:1789175534.493479:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.493502:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.493530:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.493552:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175534.493624:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:2354:x1876086251106432:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 212us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175534.493631:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00010000:00010000:2.0:1789175534.494977:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c94 expref: 23 pid: 5840 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175534.494999:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734747b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274193536:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175534.495028:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.495053:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.495059:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175534.495080:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789175534.495243:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16c6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 24 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.495258:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.495266:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:2.0:1789175534.495269:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175534.495272:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5e00, rc 0) 00000100:00100000:2.0:1789175534.497135:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+23:10005:x1876086251106304:12345-192.168.201.18@tcp:101:bash.0 Request processed in 10050us (10652us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789175534.497147:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:0.0:1789175534.508968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.511233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106688 00000100:00100000:1.0:1789175534.511250:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106688 00000100:00100000:1.0:1789175534.511331:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:1.0:1789175534.511360:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+23:10005:x1876086251106688:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:1.0:1789175534.511678:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.511696:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.511709:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175534.511761:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789175534.511789:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8b86d2b reply state 00000000758a466f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175534.511809:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789175534.511901:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789175534.512015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10005:x1876086251106688:12345-192.168.201.18@tcp:36:bash.0 Request processed in 674us (3056us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789175534.512029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000020:00080000:1.0:1789175534.512036:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789175534.516939:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.516956:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.516965:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.516971:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654bc00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175534.516989:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.516997:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.517014:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:2.0:1789175534.517017:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175534.517021:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.517028:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16c80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175534.519840:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.522579:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106816 00000100:00100000:3.0:1789175534.522597:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106816 00000100:00100000:3.0:1789175534.522683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:3.0:1789175534.522694:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+26:10005:x1876086251106816:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175534.522719:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175534.522740:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16c87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ca2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.522799:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca2 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.522813:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca2 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.522833:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:3.0:1789175534.522836:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175534.522840:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9800, rc 0) 00000100:00100000:3.0:1789175534.522917:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10005:x1876086251106816:12345-192.168.201.18@tcp:101:bash.0 Request processed in 225us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175534.522941:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:1.0:1789175534.526271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175534.526475:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251106944 00000100:00100000:2.0:1789175534.526488:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251106944 00000100:00100000:2.0:1789175534.526592:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1789175534.526603:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:10005:x1876086251106944:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175534.526623:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175534.526669:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ca9 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789175534.526706:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4a6ed, atime: 0x6aa4a6eb, ctime: 0x6aa4a6ed, blocks: 0xb 00010000:00010000:2.0:1789175534.526733:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1789175534.526737:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175534.526744:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.526763:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.526792:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:2.0:1789175534.526865:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10005:x1876086251106944:12345-192.168.201.18@tcp:101:bash.0 Request processed in 265us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175534.526871:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1789175534.529605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.529672:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107072 00000100:00100000:3.0:1789175534.529684:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107072 00002000:00010000:3.0:1789175534.529739:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789175534.529745:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e3cdc00 with x1876086251107072 ext(0->18446744073709551615) 00002000:00010000:3.0:1789175534.529760:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72e3cdc00. 00000100:00100000:3.0:1789175534.529801:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1789175534.529812:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251107072:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:3.0:1789175534.530549:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789175534.530555:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789175533 -> 1789175534 00002000:00010000:3.0:1789175534.530558:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789175531 -> 1789175531 00002000:00010000:3.0:1789175534.530560:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789175533 -> 1789175534 00002000:00010000:3.0:1789175534.530563:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789175534.530744:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251107072:12345-192.168.201.18@tcp:10:bash.0 Request processed in 931us (1153us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789175534.530755:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00010000:3.0:1789175534.530760:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789175534.530763:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e3cdc00 with x1876086251107072 ext(0->18446744073709551615) 00002000:00010000:3.0:1789175534.530770:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72e3cdc00. 00000100:00100000:0.0:1789175534.626004:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.626156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107200 00000100:00100000:1.0:1789175534.626171:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107200 00000100:00100000:1.0:1789175534.626252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1789175534.626265:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10491:x1876086251107200:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1789175534.626419:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626443:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626458:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626478:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626486:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626493:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626826:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626837:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626857:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175534.626912:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626925:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626932:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626941:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626947:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654aa00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.626953:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626961:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626976:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175534.626980:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.626986:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.626994:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627008:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627021:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627028:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627033:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.627037:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627044:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627052:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e721b55d00) 00010000:00010000:1.0:1789175534.627055:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.627058:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627083:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627089:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627096:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627101:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175534.627109:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627115:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627124:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:1.0:1789175534.627127:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175534.627129:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.627135:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175534.627226:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10491:x1876086251107200:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 962us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175534.627237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1789175534.709574:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.709742:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107456 00000100:00100000:3.0:1789175534.709755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107456 00000100:00100000:3.0:1789175534.709835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1789175534.709848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+27:10494:x1876086251107456:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175534.709878:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175534.709907:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cb0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710042:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710075:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710090:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710110:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710118:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710125:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710804:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16cbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710818:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710827:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175534.710841:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789175534.710980:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.710989:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711005:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711011:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.711017:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711027:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711042:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175534.711046:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175534.711052:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711059:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711075:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711081:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711087:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711092:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.711095:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711114:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711123:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051dbb00) 00010000:00010000:3.0:1789175534.711126:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175534.711129:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711135:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711188:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb0 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711203:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb0 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.711211:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:3.0:1789175534.711214:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789175534.711216:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9600, rc 0) 00000100:00100000:3.0:1789175534.711317:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+29:10494:x1876086251107456:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1470us (1758us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789175534.711327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:0.0:1789175534.720922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.721156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107584 00000100:00100000:3.0:1789175534.721169:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107584 00000100:00100000:3.0:1789175534.721248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:3.0:1789175534.721262:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+29:10494:x1876086251107584:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175534.721423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.721445:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 29 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.721457:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.721506:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 29 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.721536:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 29 pid: 8054 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175534.721553:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e453100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193664:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175534.721684:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175534.727839:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e453100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274193664:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175534.727892:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175534.733842:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.734498:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107840 00000100:00100000:1.0:1789175534.734513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107840 00000100:00100000:1.0:1789175534.734602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1789175534.734614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+30:6054:x1876086251107840:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1789175534.735217:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1789175534.735473:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:6054:x1876086251107840:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 860us (1644us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789175534.735485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000020:00080000:1.0:1789175534.735490:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789175534.744134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175534.744413:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251107968 00000100:00100000:1.0:1789175534.744428:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251107968 00010000:00010000:1.0:1789175534.744496:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 32 pid: 8054 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175534.744583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1789175534.744596:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:2356:x1876086251107968:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175534.744618:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175534.744627:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 32 pid: 8054 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744654:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 32 pid: 8054 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744685:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16c72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c9b expref: 32 pid: 8054 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744709:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:1.0:1789175534.744716:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744728:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744738:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.744787:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175534.744920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+31:2356:x1876086251107968:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 326us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175534.744929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00010000:00010000:2.0:1789175534.745917:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.745932:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.745978:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.745986:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.745993:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.746000:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175534.746007:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.746016:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.746030:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:2.0:1789175534.746034:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175534.746039:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.746061:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175534.746154:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10494:x1876086251107584:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 24894us (25244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175534.746164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:3.0:1789175534.751511:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175534.751694:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251108224 00000100:00100000:2.0:1789175534.751708:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251108224 00000100:00100000:2.0:1789175534.751786:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175534.751799:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+30:10494:x1876086251108224:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175534.752447:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:10494:x1876086251108224:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 646us (943us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789175534.752458:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1789175534.849299:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.849686:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251108480 00000100:00100000:3.0:1789175534.849701:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251108480 00000100:00100000:3.0:1789175534.849784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:3.0:1789175534.849797:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+31:10505:x1876086251108480:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1789175534.849833:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175534.849869:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cb7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.849987:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.850005:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.850019:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.850037:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.850044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.850051:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851051:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851068:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851078:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175534.851091:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789175534.851589:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851615:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851622:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851629:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.851634:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851642:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851658:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175534.851660:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175534.851666:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851673:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16cdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851689:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851694:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851699:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851704:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.851712:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851719:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851727:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051dbb00) 00010000:00010000:3.0:1789175534.851729:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175534.851733:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851738:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16ce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851799:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb7 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851814:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb7 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.851821:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:3.0:1789175534.851823:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175534.851826:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8400, rc 0) 00000100:00100000:3.0:1789175534.851924:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10505:x1876086251108480:12345-192.168.201.18@tcp:101:cat.0 Request processed in 2129us (2640us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789175534.851934:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:0.0:1789175534.876963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.879061:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251108736 00000100:00100000:3.0:1789175534.879085:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251108736 00000100:00100000:3.0:1789175534.879245:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:3.0:1789175534.879259:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10505:x1876086251108736:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:3.0:1789175534.879773:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+34:10505:x1876086251108736:12345-192.168.201.18@tcp:35:cat.0 Request processed in 515us (2825us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789175534.879783:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1789175534.938654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175534.938757:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251108992 00000100:00100000:3.0:1789175534.938770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251108992 00000100:00100000:3.0:1789175534.938844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:3.0:1789175534.938856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+34:10506:x1876086251108992:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:3.0:1789175534.938930:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789175534.938964:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16ce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb7 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.938989:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16cbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cb0 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939014:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16c87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca2 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939025:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7102ecf00) 00010000:00010000:3.0:1789175534.939039:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175534.939069:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939085:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939098:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939134:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939141:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939147:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939550:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939560:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.939568:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789175534.940287:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789175534.940300:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319898957830ns, next at 320898954482ns, rc = 0 00010000:00010000:3.0:1789175534.940415:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.940427:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.940435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.940444:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.940462:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.940468:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942635:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175534.942816:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942831:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942839:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942855:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.942861:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942870:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942891:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051db600) 00010000:00010000:3.0:1789175534.942895:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789175534.942902:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942910:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942941:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.942965:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.943770:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.943778:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175534.943783:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.943802:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.943819:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175534.943822:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175534.943826:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175534.943833:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16cf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789175534.944108:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007163450d reply state 00000000054476df transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175534.944120:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789175534.944990:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+33:10506:x1876086251108992:12345-192.168.201.18@tcp:36:rm.0 Request processed in 6117us (6332us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789175534.948156:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00010000:00010000:1.0:1789175534.949780:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175534.949922:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.949938:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175534.949943:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.949955:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.950734:0:6702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97e7051db600) 00010000:00010000:1.0:1789175534.950740:0:6702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789175534.950748:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175534.950758:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8000/0x1112cdeac4c16d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175534.951787:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175534.951794:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175534.951807:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175534.954061:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954086:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954095:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954102:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175534.954108:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954118:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954166:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051dbb00) 00010000:00010000:2.0:1789175534.954169:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175534.954176:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175534.954183:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16cfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.010945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.011184:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251109248 00000100:00100000:2.0:1789175535.011197:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251109248 00000100:00100000:2.0:1789175535.011745:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:2.0:1789175535.011761:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+32:10512:x1876086251109248:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175535.011805:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.011835:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cbe expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012026:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012045:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012059:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012076:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012084:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.012112:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175535.014395:0:8054:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789175535.014885:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014909:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014923:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014972:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014979:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014988:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.014994:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.015000:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.015009:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.015022:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175535.015024:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.015042:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.015048:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175535.015066:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056fb6e0c reply state 000000008ef712ca transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.015076:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789175535.015122:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 35 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.015141:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 34 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.015149:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:2.0:1789175535.015152:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175535.015154:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5800, rc 0) 00000100:00100000:2.0:1789175535.015258:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+35:10512:x1876086251109248:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3500us (4326us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789175535.015269:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00010000:00010000:2.0:1789175535.019787:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019810:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019818:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019850:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.019856:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019866:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019887:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7181cd300) 00010000:00010000:2.0:1789175535.019890:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.019895:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.019902:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16d21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.021231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.021535:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251109376 00000100:00100000:3.0:1789175535.021551:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251109376 00000100:00100000:3.0:1789175535.021665:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1789175535.021680:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251109376:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175535.021703:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.021725:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cc5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175535.021757:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175535.021779:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1789175535.021783:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175535.021792:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.021816:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.021834:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8a00, rc 0) 00000100:00100000:3.0:1789175535.021918:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251109376:12345-192.168.201.18@tcp:101:bash.0 Request processed in 242us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.021926:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00080000:2.0:1789175535.022299:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175535.028776:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.028965:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251109504 00000100:00100000:2.0:1789175535.028981:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251109504 00000100:00100000:2.0:1789175535.029108:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1789175535.029124:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:10512:x1876086251109504:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175535.029149:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.029173:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ccc expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.029217:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.029227:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175535.029250:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175535.029257:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.029307:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.029330:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.029370:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876086274193792:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175535.029493:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175535.032936:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.033080:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876086274193792:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175535.033128:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.033156:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4600, rc 0) 00000100:00100000:2.0:1789175535.033237:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:10512:x1876086251109504:12345-192.168.201.18@tcp:101:bash.0 Request processed in 4116us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.033248:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1789175535.034391:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251109632 00000100:00100000:1.0:1789175535.034406:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251109632 00010000:00010000:1.0:1789175535.034610:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.034769:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1789175535.034781:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707444050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251109632:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175535.034821:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175535.034852:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.034867:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.034896:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c16d36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cc5 expref: 7 pid: 6686 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.034916:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175535.034921:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175535.034931:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.034943:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.034991:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.035007:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274193920:192.168.201.18@tcp:105: 00000100:00100000:1.0:1789175535.035130:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175535.039006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.039106:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251109888 00000100:00100000:2.0:1789175535.039118:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251109888 00000100:00100000:2.0:1789175535.039195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:2.0:1789175535.039209:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+34:10512:x1876086251109888:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1789175535.039751:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+35:10512:x1876086251109888:12345-192.168.201.18@tcp:35:bash.0 Request processed in 542us (757us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789175535.039776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1789175535.040771:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274193920:192.168.201.18@tcp:105: 00010000:00010000:1.0:1789175535.040806:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175535.040917:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707444050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251109632:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 6136us (7994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175535.040929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00010000:00010000:2.0:1789175535.074574:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175535.174976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.175141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110016 00000100:00100000:2.0:1789175535.175157:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110016 00000100:00100000:2.0:1789175535.175235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1789175535.175249:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+35:10528:x1876086251110016:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175535.175285:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.175313:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175429:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175452:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175464:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175535.175503:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789175535.175506:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175535.175537:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175566:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c16d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cd3 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175588:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cd3 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.175628:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175535.175631:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175535.175636:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4800, rc 0) 00000100:00100000:2.0:1789175535.175970:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10528:x1876086251110016:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 722us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.175980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1789175535.182716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.182834:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110272 00000100:00100000:3.0:1789175535.182857:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110272 00000100:00100000:3.0:1789175535.182935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:3.0:1789175535.182948:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+36:10528:x1876086251110272:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175535.182977:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.183006:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cda expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.183338:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.183402:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.183419:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175535.183434:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789175535.184552:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cda expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.184599:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16d59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cda expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.184610:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:3.0:1789175535.184613:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175535.184619:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9800, rc 0) 00000100:00100000:3.0:1789175535.185042:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+38:10528:x1876086251110272:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2092us (2338us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789175535.185066:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:3.0:1789175535.190416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.190478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175535.190608:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110528 00000100:00100000:1.0:1789175535.190621:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110528 00000100:00100000:1.0:1789175535.190707:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:1.0:1789175535.190720:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+38:10528:x1876086251110528:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175535.190751:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175535.190777:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16d67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ce1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.190923:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.190945:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.190961:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175535.190978:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789175535.191391:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16d67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce1 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.191414:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce1 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.191425:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:1.0:1789175535.191428:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789175535.191461:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175535.191555:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+40:10528:x1876086251110528:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 836us (1231us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789175535.191565:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:0.0:1789175535.192212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110656 00000100:00100000:0.0:1789175535.192220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110656 00000100:00100000:0.0:1789175535.192278:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1789175535.192287:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+40:2356:x1876086251110656:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175535.192302:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175535.192323:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16d59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cda expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.192368:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:0.0:1789175535.192383:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175535.192415:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+39:2356:x1876086251110656:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 129us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175535.192422:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1789175535.197685:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.197957:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110784 00000100:00100000:3.0:1789175535.197975:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110784 00000100:00100000:3.0:1789175535.198061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:3.0:1789175535.198076:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251110784:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:3.0:1789175535.198175:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.198206:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.198217:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789175535.198223:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175535.198229:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.198284:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.198302:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 6 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.198323:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274194048:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175535.198497:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070ffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175535.201319:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274194048:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175535.201396:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.204279:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.204642:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251110912 00000100:00100000:0.0:1789175535.204657:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251110912 00002000:00100000:0.0:1789175535.204732:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97e72e45aa00 x1876086251110912/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:706/0 lens 504/0 e 0 to 0 dl 1789175546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175535.204744:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e45aa00 with x1876086251110912 ext(0->8) 00010000:00010000:0.0:1789175535.204756:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 7 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.204776:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 7 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175535.204784:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e72e45aa00 00000100:00100000:0.0:1789175535.204824:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1789175535.204835:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251110912:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:0.0:1789175535.205912:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251110912:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 1069us (1640us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789175535.205925:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00100000:0.0:1789175535.205936:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97e72e45aa00 x1876086251110912/t4294967302(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:706/0 lens 504/448 e 0 to 0 dl 1789175546 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175535.205947:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72e45aa00 with x1876086251110912 ext(0->8) 00010000:00010000:0.0:1789175535.205956:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.205985:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175535.205993:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e72e45aa00 00000100:00100000:1.0:1789175535.209560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.209627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111040 00000100:00100000:3.0:1789175535.209650:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111040 00010000:00010000:3.0:1789175535.209707:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.209789:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1789175535.209802:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251111040:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175535.209823:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789175535.209957:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789175535.209961:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789175535 00002000:00010000:3.0:1789175535.209964:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789175535 00002000:00010000:3.0:1789175535.209966:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789175535 00010000:00010000:3.0:1789175535.209974:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.209991:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.210021:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c51710/0x1112cdeac4c16d3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ccc expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.210043:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175535.210060:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175535.210068:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.210080:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.210125:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175535.210211:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251111040:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 411us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.210221:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00010000:00010000:1.0:1789175535.210336:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210383:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210416:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210425:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210434:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210455:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175535.210460:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210471:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210494:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.210503:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af9f176e/0x1112cdeac4c16d7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.210577:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251110784:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 12505us (12907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175535.210586:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:3.0:1789175535.216942:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.217177:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111296 00000100:00100000:0.0:1789175535.217191:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111296 00000100:00100000:0.0:1789175535.217264:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:0.0:1789175535.217277:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708380c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+39:10528:x1876086251111296:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1789175535.217403:0:11956:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce1 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175535.218115:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789175535.218166:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789175535.219119:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1789175535.219200:0:11956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.219222:0:11956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 43 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.219234:0:11956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.219284:0:11956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 43 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.219305:0:11956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 43 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175535.219337:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274194176:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175535.220248:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70f932d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175535.224395:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.225026:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111424 00000100:00100000:2.0:1789175535.225041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111424 00010000:00010000:2.0:1789175535.225132:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 44 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.225195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1789175535.225208:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+44:2354:x1876086251111424:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175535.225233:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175535.225244:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 44 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.225263:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 44 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.225297:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:2.0:1789175535.225305:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.225318:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.225379:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.225408:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175535.225735:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+44:2354:x1876086251111424:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 528us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.225746:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00010000:00010000:1.0:1789175535.227723:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16d28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cbe expref: 43 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.227750:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274194176:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175535.227783:0:11956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.227795:0:11956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.227803:0:11956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175535.228161:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1789175535.228732:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789175535.228996:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e45bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274194304:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789175535.229096:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175535.229147:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175535.229246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274194304 00000100:00100000:2.0:1789175535.229257:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274194304 00000100:00100000:2.0:1789175535.229418:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175535.229431:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11956:x1876086274194304:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789175535.229561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11956:x1876086274194304:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 132us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.229569:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175535.229928:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e45bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274194304:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789175535.230619:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789175535.230792:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e453b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274194432:0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:1.0:1789175535.232018:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175535.232125:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175535.232213:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70767e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789175535.232284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274194432 00000100:00100000:1.0:1789175535.232293:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274194432 00000100:00100000:1.0:1789175535.232384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789175535.232395:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11956:x1876086274194432:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789175535.232709:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:11956:x1876086274194432:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 316us (586us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789175535.232719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175535.232827:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e453b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274194432:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789175535.232931:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789175535.232988:0:11956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233001:0:11956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233010:0:11956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233017:0:11956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.233022:0:11956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233032:0:11956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233053:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:3.0:1789175535.233056:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789175535.233080:0:11956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.233087:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16d83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789175535.233334:0:11956:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789175535.233523:0:11956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789175535.233538:0:11956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320192196332ns, next at 321192193602ns, rc = 0 00000001:00080000:3.0:1789175535.233545:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789175535.233582:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7181cd600) 00010000:00010000:3.0:1789175535.233585:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789175535.233593:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16d6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce1 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.233738:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708380c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+46:10528:x1876086251111296:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 16464us (16810us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789175535.233748:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000020:00080000:3.0:1789175535.233752:0:11956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789175535.237158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.237257:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111552 00000100:00100000:3.0:1789175535.237270:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111552 00000100:00100000:3.0:1789175535.237409:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:3.0:1789175535.237423:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+46:10528:x1876086251111552:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175535.237466:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.237499:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ce8 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.237600:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce8 expref: 47 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.237660:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce8 expref: 47 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.237685:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.237689:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175535.237693:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8c00, rc 0) 00000100:00100000:3.0:1789175535.237763:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+47:10528:x1876086251111552:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 343us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.237771:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:1.0:1789175535.242028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.242225:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111808 00000100:00100000:0.0:1789175535.242239:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111808 00000100:00100000:2.0:1789175535.242538:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:2.0:1789175535.242555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+47:10528:x1876086251111808:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175535.243201:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10528:x1876086251111808:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 648us (1186us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789175535.243212:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1789175535.314662:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.314784:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251111936 00000100:00100000:3.0:1789175535.314796:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251111936 00000100:00100000:3.0:1789175535.314877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:3.0:1789175535.314890:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10538:x1876086251111936:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:3.0:1789175535.314999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315036:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315069:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315077:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315108:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315229:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315258:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789175535.315319:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315335:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315391:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315399:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315404:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.315410:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315417:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315432:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175535.315442:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.315449:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315456:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16d91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315473:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315480:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315486:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315491:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.315494:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315500:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315520:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051db200) 00010000:00010000:3.0:1789175535.315522:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.315525:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315530:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315546:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315559:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315565:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315570:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.315574:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315581:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315589:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.315592:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.315595:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.315601:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16d9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.315701:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10538:x1876086251111936:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 812us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.315710:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:0.0:1789175535.352713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.352943:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251112192 00000100:00100000:3.0:1789175535.352957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251112192 00000100:00100000:3.0:1789175535.353037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:3.0:1789175535.353204:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+48:10541:x1876086251112192:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175535.353235:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.353287:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353450:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353469:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353484:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353503:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353521:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353528:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353705:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16dbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353714:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.353721:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175535.353732:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789175535.354260:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354286:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354294:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354301:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.354425:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354435:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354450:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175535.354454:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.354460:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354466:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354484:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354491:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354497:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354502:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.354521:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354528:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354537:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051db200) 00010000:00010000:3.0:1789175535.354540:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.354543:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.354548:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.357311:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cef expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.357373:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16dbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cef expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.357384:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175535.357410:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175535.357415:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8e00, rc 0) 00000100:00100000:2.0:1789175535.357536:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+50:10541:x1876086251112192:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4486us (4848us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789175535.357548:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:1.0:1789175535.361586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.361701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251112320 00000100:00100000:3.0:1789175535.361717:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251112320 00000100:00100000:3.0:1789175535.361806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:3.0:1789175535.361820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+50:10541:x1876086251112320:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175535.361917:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.361939:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.361953:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.361987:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.361995:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.362027:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.362033:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.362038:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.362046:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.362060:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.362063:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175535.362069:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.362077:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.362183:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+50:10541:x1876086251112320:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 365us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.362191:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:1.0:1789175535.366698:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.366802:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251112576 00000100:00100000:3.0:1789175535.366816:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251112576 00000100:00100000:3.0:1789175535.366935:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1789175535.366950:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+50:10541:x1876086251112576:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175535.367254:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10541:x1876086251112576:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 307us (570us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789175535.367263:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:0.0:1789175535.466929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.467417:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251112832 00000100:00100000:3.0:1789175535.467432:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251112832 00000100:00100000:3.0:1789175535.467555:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:3.0:1789175535.467567:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+51:10551:x1876086251112832:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175535.467605:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.467609:0:8054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789175535.467649:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c16d4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cd3 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.467671:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175535.467678:0:8054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175535.467698:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cf6 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.467859:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.467877:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.467888:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175535.467902:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789175535.468254:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16dd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cf6 expref: 53 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.468275:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cf6 expref: 52 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.468309:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.468312:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175535.468315:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9000, rc 0) 00000100:00100000:3.0:1789175535.468525:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+52:10551:x1876086251112832:12345-192.168.201.18@tcp:101:bash.0 Request processed in 959us (1613us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789175535.468535:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:1.0:1789175535.472986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.473096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113088 00000100:00100000:3.0:1789175535.473110:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113088 00000100:00100000:3.0:1789175535.473191:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 105 00000100:00100000:3.0:1789175535.473204:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+52:10551:x1876086251113088:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1789175535.473313:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789175535.473375:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16dd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cf6 expref: 52 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.473402:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16dbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cef expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.473413:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.473419:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175535.474031:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.474210:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.474224:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789175535.474314:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1789175535.474587:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc3fe56b reply state 0000000005ecdfe7 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.474601:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789175535.474771:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+53:10551:x1876086251113088:12345-192.168.201.18@tcp:36:bash.0 Request processed in 1564us (1796us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789175535.474782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 105 00000020:00080000:3.0:1789175535.474860:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175535.477685:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477712:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477722:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477729:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.477735:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477745:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477770:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175535.477775:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.477782:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.477799:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16de5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.481228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.481393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113216 00000100:00100000:2.0:1789175535.481407:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113216 00000100:00100000:2.0:1789175535.481498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1789175535.481546:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+52:10551:x1876086251113216:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175535.481581:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.481615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16dec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2cfd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.481755:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.481778:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.481954:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175535.481996:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789175535.482002:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175535.482029:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.482289:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16dec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.482313:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.482324:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175535.482326:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175535.482331:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5a00, rc 0) 00000100:00100000:2.0:1789175535.482662:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+53:10551:x1876086251113216:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1117us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.482685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:1.0:1789175535.491384:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.491518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113472 00000100:00100000:2.0:1789175535.491532:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113472 00000100:00100000:2.0:1789175535.491598:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1789175535.491611:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+53:10551:x1876086251113472:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1789175535.491985:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+54:10551:x1876086251113472:12345-192.168.201.18@tcp:35:bash.0 Request processed in 376us (655us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789175535.491994:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:1.0:1789175535.522308:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274194560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175535.522451:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175535.522740:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274194560 00000100:00100000:2.0:1789175535.522751:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274194560 00000100:00100000:2.0:1789175535.522827:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789175535.522842:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274194560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175535.522889:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175535.522942:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274194560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.522950:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789175535.523074:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175535.523120:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274194560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175535.558704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.558914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113600 00000100:00100000:2.0:1789175535.558928:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113600 00000100:00100000:2.0:1789175535.559008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:2.0:1789175535.559020:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+54:10557:x1876086251113600:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175535.559222:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.559252:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d04 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559365:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559401:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559415:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175535.559574:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789175535.559579:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175535.559601:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559701:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d04 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559724:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d04 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.559734:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175535.559737:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175535.559742:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5c00, rc 0) 00000100:00100000:2.0:1789175535.559900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251113600:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 882us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.559908:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:1.0:1789175535.566716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.566874:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113728 00000100:00100000:3.0:1789175535.566888:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113728 00000100:00100000:3.0:1789175535.566974:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:3.0:1789175535.566986:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251113728:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175535.567013:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.567040:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d0b expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567128:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567147:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567163:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567182:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567215:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567412:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567728:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567736:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567742:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175535.567787:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789175535.567792:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789175535.567817:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567831:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567841:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567846:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567851:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567865:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.567869:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567876:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567887:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:3.0:1789175535.567889:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.567892:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567897:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567907:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567911:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567915:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567918:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.567919:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567922:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567933:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e7051db200) 00010000:00010000:3.0:1789175535.567934:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175535.567936:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567940:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567972:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567983:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 56 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.567988:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.567990:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175535.567992:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8800, rc 0) 00000100:00100000:3.0:1789175535.568074:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10557:x1876086251113728:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1089us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.568082:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:1.0:1789175535.572754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.573317:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251113984 00000100:00100000:3.0:1789175535.573331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251113984 00000100:00100000:2.0:1789175535.573639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:2.0:1789175535.573652:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10557:x1876086251113984:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175535.573680:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.573709:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16e24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573883:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573901:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573910:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573918:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573967:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.573984:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.574001:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274194688:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175535.574158:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.574168:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.574178:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734746300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274194816:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175535.574218:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175535.583044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.583386:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114112 00000100:00100000:0.0:1789175535.583402:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114112 00010000:00010000:0.0:1789175535.583463:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 58 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175535.583579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1789175535.583592:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+58:2354:x1876086251114112:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175535.583611:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175535.583620:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 58 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.583638:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 58 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.583668:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:0.0:1789175535.583675:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.583685:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.583713:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175535.583860:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+58:2354:x1876086251114112:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 269us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175535.583868:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00010000:00010000:2.0:1789175535.587555:0:5838:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.18@tcp) returned -22 from blocking AST (req@0000000005152550 x1876086274194688) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.587590:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c16e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d0b expref: 57 pid: 8054 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.587614:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274194688:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175535.587631:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734746300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274194816:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175535.587668:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175535.587675:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.587688:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.587701:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.589081:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.589392:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114240 00000100:00100000:0.0:1789175535.589404:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114240 00010000:00010000:0.0:1789175535.589459:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175535.589515:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1789175535.589527:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+57:2354:x1876086251114240:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175535.589547:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175535.589554:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589571:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589600:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c16df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2cfd expref: 57 pid: 5840 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589621:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:0.0:1789175535.589806:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589820:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589849:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.589894:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175535.589977:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+56:2354:x1876086251114240:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 450us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175535.589985:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00010000:00010000:1.0:1789175535.590930:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.590958:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175535.590986:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789175535.591918:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c16e24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.591949:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.591960:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175535.591964:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789175535.591968:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5000, rc 0) 00000100:00100000:1.0:1789175535.592063:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10557:x1876086251113984:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 18411us (19323us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789175535.592073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:1.0:1789175535.594921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.595047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114496 00000100:00100000:3.0:1789175535.595061:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114496 00000100:00100000:3.0:1789175535.595151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175535.595164:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10557:x1876086251114496:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:3.0:1789175535.595186:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175535.595241:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16d8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ce8 expref: 56 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.595267:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.595275:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175535.595572:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251114496:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 410us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.595582:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1789175535.598189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.598260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114624 00000100:00100000:3.0:1789175535.598272:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114624 00000100:00100000:3.0:1789175535.598557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1789175535.598571:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251114624:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:3.0:1789175535.598731:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.598756:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.598773:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789175535.599193:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789175535.599514:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251114624:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 933us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.599526:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:1.0:1789175535.604802:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.604972:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114752 00000100:00100000:3.0:1789175535.604986:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114752 00000100:00100000:3.0:1789175535.605063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:3.0:1789175535.605075:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+55:10557:x1876086251114752:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175535.605124:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.605153:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d19 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605247:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605260:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605283:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605299:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605316:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.605320:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175535.605324:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.605334:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8c00, rc 0) 00000100:00100000:3.0:1789175535.605826:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10557:x1876086251114752:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 751us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.605836:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000040:00080000:0.0:1789175535.843822:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789175535.843834:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175535.843907:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789175535.843916:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789175535.844165:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734211f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274194944:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789175535.844421:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70f932d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175535.849221:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.849707:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251114880 00000100:00100000:2.0:1789175535.849719:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251114880 00000100:00100000:2.0:1789175535.849798:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:2.0:1789175535.849811:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251114880:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175535.849855:0:8054:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175535.850151:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251114880:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 342us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.850170:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:0.0:1789175535.850535:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734211f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274194944:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175535.866245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.866443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251115008 00000100:00100000:2.0:1789175535.866459:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251115008 00000100:00100000:2.0:1789175535.866561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:2.0:1789175535.866706:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10558:x1876086251115008:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789175535.866815:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.866838:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.866854:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869714:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869741:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869754:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869802:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869809:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175535.869873:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789175535.869878:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175535.869893:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869907:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869914:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869921:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869927:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.869932:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869939:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869952:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:2.0:1789175535.869955:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.869961:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.869985:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870004:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870010:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870015:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.870019:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870025:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870033:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97e7181cd300) 00010000:00010000:2.0:1789175535.870036:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.870038:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870045:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870061:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870067:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870072:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870077:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.870086:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870094:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870103:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175535.870106:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.870109:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.870114:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.871419:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10558:x1876086251115008:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 4506us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.871432:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:1.0:1789175535.874183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.874363:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251115264 00000100:00100000:3.0:1789175535.874376:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251115264 00000100:00100000:3.0:1789175535.874457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:3.0:1789175535.874871:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+56:10558:x1876086251115264:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175535.874904:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.874935:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d20 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.875205:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.876360:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.876388:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175535.876412:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789175535.877656:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877675:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877684:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877691:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175535.877697:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877707:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877726:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175535.877749:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789175535.877757:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877765:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877854:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e5c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d20 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877867:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:3.0:1789175535.877869:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175535.877873:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16e5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d20 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.877884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8400, rc 0) 00000100:00100000:3.0:1789175535.877993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251115264:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3428us (3816us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1789175535.878004:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:1.0:1789175535.886157:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.889674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251115392 00000100:00100000:3.0:1789175535.889699:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251115392 00000100:00100000:2.0:1789175535.890717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:2.0:1789175535.890735:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251115392:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175535.890797:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175535.890963:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251115392:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 232us (4819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.890972:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1789175535.894252:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175535.897202:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251115648 00000100:00100000:1.0:1789175535.897232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251115648 00000100:00100000:1.0:1789175535.897327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1789175535.897362:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251115648:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175535.897414:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175535.897418:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789175535.897455:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d04 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.899444:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175535.899459:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175535.899511:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16e71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d27 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789175535.900317:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789175535.901917:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.901941:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.901956:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.902043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16e71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d27 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.902068:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d27 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.902079:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175535.902082:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175535.902105:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175535.902207:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+58:10558:x1876086251115648:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4868us (7970us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789175535.902218:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:3.0:1789175535.913279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.915892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251115904 00000100:00100000:2.0:1789175535.915918:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251115904 00000100:00100000:2.0:1789175535.916126:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1789175535.916142:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+58:10558:x1876086251115904:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789175535.917149:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175535.917217:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d27 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.917257:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:2.0:1789175535.917275:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175535.917306:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.917322:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.917334:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924614:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924653:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924737:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924746:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924752:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924758:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.924776:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924784:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924797:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175535.924801:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.924806:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924813:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16e86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924827:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924834:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924839:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.924847:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924853:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924859:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x32fca724 (ffff97e7181cd300) 00010000:00010000:2.0:1789175535.924862:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175535.924870:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.924876:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c16e8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x32fca724 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175535.924987:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251115904:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 8844us (11719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789175535.924997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:1.0:1789175535.929694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.929811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251116032 00000100:00100000:2.0:1789175535.929821:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251116032 00000100:00100000:2.0:1789175535.929872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:2.0:1789175535.929883:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+57:10558:x1876086251116032:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175535.929906:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.929932:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.929972:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.929988:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.930000:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.930127:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.930146:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.930162:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175535.930166:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175535.930170:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5c00, rc 0) 00000100:00100000:2.0:1789175535.930236:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+58:10558:x1876086251116032:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 355us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.932042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1789175535.935056:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175535.935955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251116288 00000100:00100000:1.0:1789175535.935972:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251116288 00000100:00100000:1.0:1789175535.936068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1789175535.936082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+58:10558:x1876086251116288:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789175535.936194:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.936215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175535.936228:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789175535.936598:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1789175535.936691:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000644c26ce reply state 0000000012668ec1 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.936700:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789175535.937013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+60:10558:x1876086251116288:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 933us (1972us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789175535.937022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00010000:00010000:2.0:1789175535.943043:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943072:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943081:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943088:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175535.943094:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943102:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943119:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175535.943122:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789175535.943126:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.943132:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175535.956783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.956904:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251116416 00000100:00100000:2.0:1789175535.956914:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251116416 00000100:00100000:2.0:1789175535.956975:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1789175535.956986:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+59:10558:x1876086251116416:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175535.957011:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.957031:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d35 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.957112:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 60 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.957128:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 60 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.957149:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175535.957152:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175535.957156:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175535.957225:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+60:10558:x1876086251116416:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 241us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.957232:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1789175535.961676:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175535.961789:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251116544 00000100:00100000:1.0:1789175535.961799:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251116544 00000100:00100000:1.0:1789175535.961885:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175535.961910:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251116544:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789175535.962230:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251116544:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 321us (561us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789175535.962238:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00080000:3.0:1789175535.963166:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175535.964716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.964818:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251116800 00000100:00100000:3.0:1789175535.964829:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251116800 00000100:00100000:3.0:1789175535.964938:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1789175535.964948:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+60:10558:x1876086251116800:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789175535.965682:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+61:10558:x1876086251116800:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 732us (970us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789175535.965690:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1789175535.971932:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.972035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117056 00000100:00100000:2.0:1789175535.972045:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117056 00000100:00100000:2.0:1789175535.972114:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:2.0:1789175535.972125:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+61:10558:x1876086251117056:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789175535.972792:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+61:10558:x1876086251117056:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 664us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.972821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:1.0:1789175535.974885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.974952:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117184 00000100:00100000:2.0:1789175535.974960:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117184 00000100:00100000:2.0:1789175535.975005:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:2.0:1789175535.975012:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+61:10558:x1876086251117184:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175535.975028:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175535.975044:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d3c expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975108:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975120:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975128:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175535.975157:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175535.975171:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975190:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d3c expref: 63 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975204:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d3c expref: 62 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175535.975209:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175535.975222:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789175535.975225:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5200, rc 0) 00000100:00100000:2.0:1789175535.975286:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+62:10558:x1876086251117184:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 272us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.975293:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1789175535.981865:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175535.981936:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117312 00000100:00100000:3.0:1789175535.981945:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117312 00000100:00100000:3.0:1789175535.981994:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1789175535.982005:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251117312:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175535.982023:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175535.982043:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d43 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175535.982213:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a6f0, blocks: 0x1 00010000:00010000:3.0:1789175535.982232:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789175535.982236:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175535.982307:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.982328:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.982383:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8400, rc 0) 00000100:00100000:3.0:1789175535.983232:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2353:x1876086251117312:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1225us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175535.983257:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1789175535.986467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175535.986727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117568 00000100:00100000:2.0:1789175535.986736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117568 00000100:00100000:2.0:1789175535.986940:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:2.0:1789175535.986952:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+62:10558:x1876086251117568:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789175535.987046:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+62:10558:x1876086251117568:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 98us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175535.987052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:1.0:1789175535.990011:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.990135:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117696 00000100:00100000:0.0:1789175535.990145:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117696 00000100:00100000:0.0:1789175535.990269:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1789175535.990280:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+10:10558:x1876086251117696:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175535.990299:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175535.990318:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d4a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.990383:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.990430:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175535.990435:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175535.990441:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.990483:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.990510:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175535.990524:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274195072:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175535.990597:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70f932d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175535.993530:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175535.993629:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274195072:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175535.993657:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175535.993675:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669600, rc 0) 00000100:00100000:0.0:1789175535.993726:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+11:10558:x1876086251117696:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3449us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175535.993733:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1789175535.993864:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117824 00000100:00100000:3.0:1789175535.993881:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117824 00010000:00010000:3.0:1789175535.993907:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.993935:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1789175535.993941:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707447850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+11:2354:x1876086251117824:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175535.993951:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175535.993970:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.993979:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.993997:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c16ebe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d43 expref: 11 pid: 6685 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.994008:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175535.994011:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175535.994017:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.994024:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175535.994049:0:8505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175535.994078:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e452a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8505:1876086274195200:192.168.201.18@tcp:105: 00000100:00100000:3.0:1789175535.994121:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546300 going to sleep for 11 seconds 00000100:00100000:0.0:1789175536.000030:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e452a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8505:1876086274195200:192.168.201.18@tcp:105: 00010000:00010000:0.0:1789175536.000057:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175536.000155:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707447850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2354:x1876086251117824:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 6212us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.000168:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:1.0:1789175536.004288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175536.004517:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251117952 00000100:00100000:3.0:1789175536.004529:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251117952 00002000:00100000:3.0:1789175536.004582:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97e7343cdc00 x1876086251117952/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:707/0 lens 504/0 e 0 to 0 dl 1789175547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175536.004594:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7343cdc00 with x1876086251117952 ext(0->12) 00002000:00010000:3.0:1789175536.004601:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e7343cdc00 00000100:00100000:3.0:1789175536.004645:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1789175536.004656:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2353:x1876086251117952:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789175536.005150:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+12:2353:x1876086251117952:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 493us (868us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789175536.005159:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:3.0:1789175536.005166:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97e7343cdc00 x1876086251117952/t4294967308(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:707/0 lens 504/448 e 0 to 0 dl 1789175547 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175536.005175:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7343cdc00 with x1876086251117952 ext(0->12) 00002000:00010000:3.0:1789175536.005179:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e7343cdc00 00000100:00100000:1.0:1789175536.009987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175536.010571:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118080 00000100:00100000:2.0:1789175536.010585:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118080 00000100:00100000:2.0:1789175536.010719:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:2.0:1789175536.010731:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+62:10558:x1876086251118080:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1789175536.018468:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175536.033700:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175536.033734:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274195328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175536.033838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175536.033929:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195328 00000100:00100000:0.0:1789175536.033939:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195328 00000100:00100000:0.0:1789175536.034025:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789175536.034042:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876086274195328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789175536.034075:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175536.034140:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876086274195328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.034152:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789175536.034249:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274195328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175536.034719:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274195456:0@lo:400:kworker.0 00000100:00100000:0.0:1789175536.034777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175536.034864:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175536.034870:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274195840:0@lo:400:kworker.0 00000100:00100000:0.0:1789175536.034899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175536.035368:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195456 00000100:00100000:2.0:1789175536.035377:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195456 00000100:00100000:2.0:1789175536.035491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789175536.035514:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274195456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.035577:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274195456:12345-0@lo:400:kworker.0 Request processed in 66us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175536.035585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789175536.035753:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274195456:0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.036713:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274195584:0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.036784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175536.036822:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789175536.036828:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274195712:0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.036846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175536.036868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195840 00000100:00100000:0.0:1789175536.036885:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195840 00000100:00100000:0.0:1789175536.036950:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195584 00000100:00100000:0.0:1789175536.036953:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195584 00000100:00100000:0.0:1789175536.036965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195712 00000100:00100000:0.0:1789175536.036967:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195712 00000100:00100000:0.0:1789175536.036987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789175536.036997:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274195840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175536.037102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274195840:12345-0@lo:400:kworker.0 Request processed in 106us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.037109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789175536.037126:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789175536.037133:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274195584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175536.037167:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274195584:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.037173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789175536.037183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789175536.037188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274195712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175536.037212:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274195712:12345-0@lo:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.037217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789175536.037816:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175536.037866:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274195712:0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.037881:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274195584:0@lo:400:kworker.0 00000100:00100000:2.0:1789175536.037925:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274195840:0@lo:400:kworker.0 00000100:00100000:1.0:1789175536.058910:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+62:10558:x1876086251118080:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 48169us (48920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.058923:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000001:00080000:1.0:1789175536.058962:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967384 is committed 00000001:00080000:1.0:1789175536.058987:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000001:00080000:1.0:1789175536.059024:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1789175536.059040:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789175536.059056:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e7070ff300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789175536.059061:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e707602200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e7070ffe40 00000020:00080000:1.0:1789175536.059064:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e70548e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e737d95800 00000004:00080000:1.0:1789175536.059076:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789175536.059092:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e734030780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789175536.059096:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e72653c300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e709ea13c0 00000020:00080000:1.0:1789175536.059111:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e72653cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e734252400 00000020:00080000:0.0:1789175536.062829:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789175536.063031:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789175536.063582:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274196096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789175536.063776:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274195968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789175536.064231:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175536.064404:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175536.064593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175536.064742:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274195968 00000100:00100000:1.0:1789175536.064750:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274195968 00000100:00100000:1.0:1789175536.064790:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118208 00000100:00100000:1.0:1789175536.064793:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118208 00000100:00100000:1.0:1789175536.064804:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274196096 00000100:00100000:1.0:1789175536.064807:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274196096 00000100:00100000:1.0:1789175536.064823:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789175536.064832:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274195968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789175536.064863:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1789175536.064890:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.064911:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.064920:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789175536.064925:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175536.064929:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.064961:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.064974:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 12 pid: 6687 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.065006:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274196224:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175536.065120:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789175536.068756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175536.069006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118336 00000100:00100000:1.0:1789175536.069016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118336 00010000:00010000:1.0:1789175536.069059:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 13 pid: 6687 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.069102:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1789175536.069112:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+13:2354:x1876086251118336:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175536.069129:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175536.069134:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 13 pid: 6687 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.069148:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 13 pid: 6687 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.069179:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175536.069184:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175536.069190:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.069200:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.069240:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175536.069303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+13:2354:x1876086251118336:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 191us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.069311:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00010000:00010000:0.0:1789175536.070169:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008196aa4d/0x1112cdeac4c16c8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ca9 expref: 12 pid: 6687 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.070189:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274196224:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175536.070217:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.070301:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.070309:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.070319:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.070327:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.070439:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789175536.071234:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876086274195968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6398us (6999us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789175536.071725:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789175536.071759:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1789175536.071769:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+11:2353:x1876086251118208:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789175536.071878:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175536.071887:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.071897:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175536.071902:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.071913:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.071931:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.071939:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1e196c7/0x1112cdeac4c16ecc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.071969:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175536.071971:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175536.071973:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789175536.072075:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e7343ce300/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789175536.072092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274195968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789175536.100924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789175536.113775:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789175536.113796:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1789175536.113807:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1789175536.114048:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251118208:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 42276us (49639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.114060:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1789175536.114092:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789175536.114104:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1876086274196096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789175536.114151:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1789175536.114184:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4a6ef, atime: 0x6aa4a6ef, ctime: 0x6aa4a6ef, blocks: 0x1 00010000:00010000:0.0:1789175536.114191:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.114207:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789175536.114211:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175536.114218:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.114234:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.114255:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.114265:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.114288:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789175536.114998:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3304:x1876086274196096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 897us (50403us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789175536.115006:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789175536.115058:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e72e18f480/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789175536.115066:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274196096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789175536.115232:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175536.115247:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.115257:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175536.115261:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.115271:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.115288:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.115296:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c16ed3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.115316:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175536.115318:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175536.115320:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175536.117841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.117959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118592 00000100:00100000:0.0:1789175536.117980:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118592 00000100:00100000:0.0:1789175536.118094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:0.0:1789175536.118105:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10558:x1876086251118592:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175536.118161:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175536.118189:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c16eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d3c expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.118210:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:0.0:1789175536.118215:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175536.118259:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.118273:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.118282:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175536.118678:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022a07f9b reply state 00000000daee8dd7 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.118689:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175536.118782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+16:10558:x1876086251118592:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 677us (949us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789175536.118789:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:2.0:1789175536.122512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.122700:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118720 00000100:00100000:0.0:1789175536.122711:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118720 00000100:00100000:0.0:1789175536.122770:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1789175536.122782:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251118720:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789175536.123058:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789175536.123062:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789175535 00002000:00010000:0.0:1789175536.123065:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789175535 00002000:00010000:0.0:1789175536.123067:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789175536 -> 1789175535 00002000:00010000:0.0:1789175536.123070:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789175536.123136:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251118720:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 355us (643us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789175536.123145:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00010000:00010000:1.0:1789175536.123876:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123889:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123897:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123903:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175536.123907:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123915:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123934:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:1.0:1789175536.123937:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175536.123943:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.123948:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c16eda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.128986:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.129097:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251118976 00000100:00100000:0.0:1789175536.129109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251118976 00000100:00100000:0.0:1789175536.129202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:0.0:1789175536.129213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10558:x1876086251118976:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789175536.129299:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.129316:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.129326:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.129379:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.129691:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 15 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.129727:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274196352:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175536.129889:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73950a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789175536.133826:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274196352:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175536.133858:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.136056:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175536.136144:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119104 00000100:00100000:2.0:1789175536.136153:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119104 00010000:00010000:2.0:1789175536.136194:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 16 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.136246:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1789175536.136255:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+16:2354:x1876086251119104:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175536.136271:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175536.136278:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 16 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136292:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 16 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136315:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16e9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d2e expref: 16 pid: 5839 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136332:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175536.136337:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136400:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136426:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.136451:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175536.136577:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136585:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136623:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136630:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136636:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136641:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175536.136644:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136651:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136660:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:1.0:1789175536.136662:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789175536.136665:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.136671:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c16ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.136750:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:10558:x1876086251118976:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 7540us (7776us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789175536.136759:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:2.0:1789175536.136972:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2354:x1876086251119104:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 717us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175536.136980:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1789175536.147301:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.147806:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119232 00000100:00100000:0.0:1789175536.147818:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119232 00000100:00100000:0.0:1789175536.147930:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1789175536.147941:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251119232:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789175536.147985:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.148005:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.148015:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789175536.148019:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175536.148025:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.148061:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.148075:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 7 pid: 6686 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.148108:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274196480:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175536.148195:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73950a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175536.156321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175536.156604:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119360 00000100:00100000:1.0:1789175536.156616:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119360 00010000:00010000:1.0:1789175536.156671:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 8 pid: 6686 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.156718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1789175536.156730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251119360:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175536.156746:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175536.156772:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 8 pid: 6686 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.156789:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 8 pid: 6686 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.156818:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175536.156823:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175536.156832:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.156844:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.156890:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175536.156958:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251119360:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 231us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.156967:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00010000:00010000:2.0:1789175536.157312:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d882cb11/0x1112cdeac4c16ec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d4a expref: 7 pid: 6686 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.157330:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274196480:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175536.157544:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157556:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157563:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157590:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157599:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157622:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157628:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175536.157633:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157642:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157655:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.157663:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c16ee8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.157722:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251119232:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 9783us (10432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175536.157730:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1789175536.161989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175536.162141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119616 00000100:00100000:2.0:1789175536.162153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119616 00000100:00100000:2.0:1789175536.162267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:2.0:1789175536.162279:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10558:x1876086251119616:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789175536.162403:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162444:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162457:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162707:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162719:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162728:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162763:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 15 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.162778:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 15 pid: 8054 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.162793:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274196608:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175536.162881:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175536.165059:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274196608:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175536.165087:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.165806:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175536.166010:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119744 00000100:00100000:3.0:1789175536.166018:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119744 00010000:00010000:3.0:1789175536.166059:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 16 pid: 8054 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175536.166096:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1789175536.166107:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:2353:x1876086251119744:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175536.166134:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175536.166140:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 16 pid: 8054 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166153:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 16 pid: 8054 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166174:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c16ea9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d35 expref: 16 pid: 8054 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166191:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:3.0:1789175536.166195:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166205:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166212:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175536.166253:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175536.166318:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+15:2353:x1876086251119744:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 212us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175536.166326:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00010000:00010000:0.0:1789175536.166858:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.166869:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175536.167077:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789175536.167241:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789175536.167289:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789175536.167429:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274196736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175536.167844:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175536.167882:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e728c28600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175536.168468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274196736 00000100:00100000:1.0:1789175536.168487:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274196736 00000100:00100000:1.0:1789175536.168550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789175536.168560:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274196736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789175536.168708:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274196736:12345-0@lo:1000:mdt00_001.0 Request processed in 148us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.168716:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789175536.168923:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789175536.168938:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1789175536.168962:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e7343ce300, transno 4294967309 00000100:00100000:2.0:1789175536.168983:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274196736:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789175536.169547:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789175536.169776:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274196864:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789175536.169820:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175536.169849:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175536.170203:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274196864 00000100:00100000:0.0:1789175536.170210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274196864 00000100:00100000:0.0:1789175536.170254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789175536.170263:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1876086274196864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175536.170605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1876086274196864:12345-0@lo:1000:mdt00_001.0 Request processed in 342us (783us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789175536.170613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789175536.171213:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5839:1876086274196864:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789175536.171267:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171278:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171286:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171292:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.171296:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171304:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171320:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:2.0:1789175536.171323:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175536.171327:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171333:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c16ef6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171410:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171425:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171432:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171436:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.171439:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171445:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171453:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175536.171456:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175536.171462:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171705:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171716:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.171756:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.171780:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274196992:192.168.201.18@tcp:105: 00000100:00100000:2.0:1789175536.171859:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175536.176672:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175536.176780:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251119872 00000100:00100000:1.0:1789175536.176790:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251119872 00000100:00100000:1.0:1789175536.176838:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1789175536.176847:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10557:x1876086251119872:12345-192.168.201.18@tcp:49:lfs.0 00000100:00100000:1.0:1789175536.176978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:10557:x1876086251119872:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 131us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.176985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1789175536.177133:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e452d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274196992:192.168.201.18@tcp:105: 00010000:00010000:2.0:1789175536.177160:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c16e39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177199:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177212:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177223:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177232:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177250:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177257:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177263:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.177267:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177288:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177299:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175536.177302:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175536.177306:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177312:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c16efd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177322:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177329:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177336:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177355:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.177358:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177364:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177371:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175536.177373:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175536.177376:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.177403:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16eef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175536.177621:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10558:x1876086251119616:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 15336us (15632us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1789175536.177631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000020:00080000:2.0:1789175536.177634:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789175536.177934:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175536.177939:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175536.178602:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789175536.178612:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789175536.183959:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175536.184178:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251120128 00000100:00100000:1.0:1789175536.184189:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251120128 00000100:00100000:1.0:1789175536.184604:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:1.0:1789175536.184683:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10557:x1876086251120128:12345-192.168.201.18@tcp:58:lfs.0 00000040:00080000:1.0:1789175536.185088:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789175536.185309:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10557:x1876086251120128:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 622us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175536.185320:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:2.0:1789175536.185858:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175536.187205:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251120384 00000100:00100000:3.0:1789175536.187220:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251120384 00000100:00100000:2.0:1789175536.188223:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:2.0:1789175536.188247:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e708381050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+18:10558:x1876086251120384:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789175536.189335:0:11956:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789175536.189790:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1789175536.189847:0:11956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189866:0:11956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189879:0:11956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189888:0:11956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189894:0:11956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189900:0:11956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.189985:0:11956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789175536.190101:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e708381050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+20:10558:x1876086251120384:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1864us (4242us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789175536.190111:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000020:00080000:2.0:1789175536.190116:0:11956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789175536.191788:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175536.191814:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.191824:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175536.191827:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.191836:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.191851:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97e7181cdf00) 00010000:00010000:0.0:1789175536.191855:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789175536.191859:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.191865:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c16f04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.191886:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175536.191888:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175536.191890:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175536.221111:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.221320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251120512 00000100:00100000:0.0:1789175536.221331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251120512 00000100:00100000:1.0:1789175536.221602:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:1.0:1789175536.221619:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+20:10560:x1876086251120512:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175536.221640:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175536.221659:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d51 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221724:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221737:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221745:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221758:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221763:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221767:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221985:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.221999:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.222005:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.222031:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175536.222040:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 21 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.222149:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274197120:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175536.222231:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789175536.224910:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.224997:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251120768 00000100:00100000:0.0:1789175536.225004:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251120768 00000100:00100000:0.0:1789175536.225050:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1789175536.225056:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:6054:x1876086251120768:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789175536.225730:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+23:6054:x1876086251120768:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 671us (828us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789175536.225737:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1789175536.226104:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274197120:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175536.226131:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175536.228442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175536.228597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251120896 00000100:00100000:0.0:1789175536.228625:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251120896 00010000:00010000:0.0:1789175536.228660:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 23 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175536.228704:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1789175536.228714:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+23:2353:x1876086251120896:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175536.228729:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175536.228734:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 23 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228743:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 23 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228760:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c16e2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d12 expref: 23 pid: 5838 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228772:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:0.0:1789175536.228776:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228783:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228788:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175536.228958:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175536.229002:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:2353:x1876086251120896:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 289us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175536.229014:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00010000:00010000:2.0:1789175536.230103:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230113:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175536.230153:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789175536.230156:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175536.230170:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230187:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230192:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230207:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230211:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.230214:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230219:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230229:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:2.0:1789175536.230232:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175536.230243:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230249:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c16f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230263:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230269:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230273:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230278:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175536.230280:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230298:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230305:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97e721b55200) 00010000:00010000:2.0:1789175536.230307:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175536.230311:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230316:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c16f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230512:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16f0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d51 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230528:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d51 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175536.230533:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:2.0:1789175536.230535:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175536.230537:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b600, rc 0) 00000100:00100000:2.0:1789175536.230585:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10560:x1876086251120512:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 8975us (9482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175536.230592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 129 00000001:00080000:0.0:1789175536.645128:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789175536.645144:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1789175537.137748:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789175537.190136:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789175537.190150:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175537.190193:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789175537.190201:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789175537.190823:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274197248:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789175537.190978:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789175537.203205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175537.203255:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251121024 00000100:00100000:1.0:1789175537.203279:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251121024 00000100:00100000:1.0:1789175537.203382:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:1.0:1789175537.203394:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:10571:x1876086251121024:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789175537.203445:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789175537.208999:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:10571:x1876086251121024:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 5591us (5794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175537.209019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:3.0:1789175537.209204:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274197248:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789175537.212891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175537.213065:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251121280 00000100:00100000:3.0:1789175537.213087:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251121280 00000100:00100000:3.0:1789175537.213170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:3.0:1789175537.213185:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+21:10571:x1876086251121280:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175537.213213:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175537.213242:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.213428:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.213447:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.213462:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175537.213485:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789175537.213657:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d58 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.213681:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d58 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.213691:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175537.213694:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175537.213698:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8400, rc 0) 00000100:00100000:3.0:1789175537.213775:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+23:10571:x1876086251121280:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 594us (899us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789175537.213783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:3.0:1789175537.221276:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175537.222714:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251121408 00000100:00100000:0.0:1789175537.222731:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251121408 00000100:00100000:0.0:1789175537.224007:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1789175537.224031:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+23:2355:x1876086251121408:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175537.224060:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175537.224105:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c16f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d58 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175537.224132:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:0.0:1789175537.224138:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175537.224226:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+22:2355:x1876086251121408:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 204us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175537.224234:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1789175537.232504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175537.232551:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251121664 00000100:00100000:3.0:1789175537.232563:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251121664 00000100:00100000:3.0:1789175537.232645:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 132 00000100:00100000:3.0:1789175537.232657:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+22:10571:x1876086251121664:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789175537.232774:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.232797:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.232810:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233689:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233704:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233713:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233720:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175537.233726:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233736:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233754:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175537.233770:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789175537.233776:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.233784:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175537.234127:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+23:10571:x1876086251121664:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 1468us (1635us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789175537.234139:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 132 00000040:00080000:3.0:1789175537.234525:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789175537.234531:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789175537.237786:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789175537.237818:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175537.246192:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175537.246299:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251121920 00000100:00100000:1.0:1789175537.246313:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251121920 00000100:00100000:1.0:1789175537.246456:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:1.0:1789175537.246470:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+23:10571:x1876086251121920:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789175537.246817:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:10571:x1876086251121920:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 349us (638us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789175537.246826:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000040:00080000:2.0:1789175537.326459:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789175537.326485:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789175537.326545:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789175537.326551:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789175537.552042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175537.552148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122176 00000100:00100000:3.0:1789175537.552160:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122176 00000100:00100000:3.0:1789175537.552229:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:3.0:1789175537.552238:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:10584:x1876086251122176:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1789175537.552267:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175537.552289:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d5f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.552460:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16f4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.552491:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.552505:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175537.552535:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789175537.552824:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16f43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d5f expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.552841:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16f4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d5f expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.552848:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175537.552851:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789175537.552856:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9600, rc 0) 00000100:00100000:3.0:1789175537.553064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:10584:x1876086251122176:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 824us (1034us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789175537.553073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:1.0:1789175537.556977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175537.557136:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122304 00000100:00100000:3.0:1789175537.557150:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122304 00000100:00100000:3.0:1789175537.557256:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:3.0:1789175537.557268:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+26:10584:x1876086251122304:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175537.557408:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557430:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557445:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557503:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557528:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557536:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557543:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175537.557549:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557558:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557573:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:3.0:1789175537.557576:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175537.557583:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.557599:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9800/0x1112cdeac4c16f58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175537.557698:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+26:10584:x1876086251122304:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 431us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175537.557707:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:0.0:1789175537.680968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175537.681119:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122432 00000100:00100000:3.0:1789175537.681135:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122432 00000100:00100000:3.0:1789175537.681234:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1789175537.681251:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251122432:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1789175537.681273:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175537.681318:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c16f5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d66 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175537.681418:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4a6ef, atime: 0x6aa4a6ef, ctime: 0x6aa4a6ef, blocks: 0xb 00010000:00010000:3.0:1789175537.681445:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1789175537.681450:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175537.681463:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c16f5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d66 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.681495:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c16f5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d66 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175537.681511:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9800, rc 0) 00000100:00100000:3.0:1789175537.681580:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251122432:12345-192.168.201.18@tcp:101:cat.0 Request processed in 336us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175537.681827:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00080000:2.0:1789175537.683160:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175537.691313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175537.691799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122560 00000100:00100000:1.0:1789175537.691814:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122560 00002000:00100000:1.0:1789175537.691882:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97e734211c00 x1876086251122560/t0(0) o3->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:708/0 lens 488/0 e 0 to 0 dl 1789175548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789175537.691955:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e734211c00 with x1876086251122560 ext(0->4095) 00002000:00010000:1.0:1789175537.691963:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e734211c00 00000100:00100000:1.0:1789175537.692003:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:1.0:1789175537.692015:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251122560:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:1.0:1789175537.692325:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251122560:12345-192.168.201.18@tcp:3:cat.0 Request processed in 310us (1027us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789175537.692738:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:1.0:1789175537.692748:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97e734211c00 x1876086251122560/t0(0) o3->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:708/0 lens 488/4536 e 0 to 0 dl 1789175548 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789175537.692758:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e734211c00 with x1876086251122560 ext(0->4095) 00002000:00010000:1.0:1789175537.692763:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e734211c00 00000100:00100000:1.0:1789175537.793035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175537.793171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175537.793216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175537.793853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122944 00000100:00100000:2.0:1789175537.793868:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122944 00000100:00100000:2.0:1789175537.793987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:2.0:1789175537.794001:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251122944:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175537.794104:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251122944:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 106us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175537.794113:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:0.0:1789175537.794373:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122816 00000100:00100000:0.0:1789175537.794396:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122816 00000100:00100000:0.0:1789175537.794454:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1789175537.794471:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251122816:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175537.794510:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251122816:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 48us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175537.794518:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00080000:1.0:1789175537.794913:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175537.794926:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175537.807679:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251122688 00000100:00100000:3.0:1789175537.807701:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251122688 00000100:00100000:2.0:1789175537.807874:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 286 00000100:00100000:2.0:1789175537.807887:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251122688:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175537.808021:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251122688:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 136us (15709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175537.808029:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 286 00010000:00010000:0.0:1789175538.145812:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175539.172243:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175540.193496:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789175540.641842:0:6833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325600496649ns, next at 326600494179ns, rc = 0 00000100:00100000:0.0:1789175540.641980:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175540.642007:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274197376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175540.642085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175540.642323:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274197376 00000100:00100000:2.0:1789175540.642330:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274197376 00000100:00100000:2.0:1789175540.642435:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789175540.642447:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274197376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175540.642483:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175540.642682:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274197376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175540.642691:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789175540.642748:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274197376:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789175540.642845:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175541.154279:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274197632:0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.154373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175541.154501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274197504:0@lo:400:kworker.0 00000100:00100000:3.0:1789175541.154549:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175541.154581:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274197504 00000100:00100000:3.0:1789175541.154589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274197504 00000100:00100000:3.0:1789175541.154635:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789175541.154644:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175541.154690:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274197504:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175541.154698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789175541.154859:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274198144:0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.154888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175541.154912:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274197760:0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.154935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175541.154955:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274197888:0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.154981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175541.155004:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274197632 00000100:00100000:1.0:1789175541.155007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274197632 00000100:00100000:1.0:1789175541.155034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274197760 00000100:00100000:1.0:1789175541.155037:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274197760 00000100:00100000:1.0:1789175541.155062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789175541.155068:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.155103:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274197632:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175541.155109:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789175541.155121:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789175541.155127:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274197760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.155152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274197760:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175541.155158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789175541.157682:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274197504:0@lo:400:kworker.0 00000100:00100000:3.0:1789175541.157698:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274198016:0@lo:400:kworker.0 00000100:00100000:3.0:1789175541.157759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175541.157859:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198016 00000100:00100000:1.0:1789175541.157865:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198016 00000100:00100000:1.0:1789175541.157912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789175541.157921:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175541.157987:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274198016:12345-0@lo:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175541.157995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789175541.158044:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274197632:0@lo:400:kworker.0 00000100:00100000:0.0:1789175541.162180:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198144 00000100:00100000:0.0:1789175541.162196:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198144 00000100:00100000:0.0:1789175541.162254:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274197888 00000100:00100000:0.0:1789175541.162258:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274197888 00000100:00100000:0.0:1789175541.162280:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789175541.162290:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175541.162687:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789175541.162700:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789175541.162839:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274198144:12345-0@lo:400:kworker.0 Request processed in 548us (7948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175541.162848:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789175541.162869:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789175541.162876:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73bad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274197888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175541.162927:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73bad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274197888:12345-0@lo:400:kworker.0 Request processed in 52us (7945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175541.162933:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789175541.163072:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789175541.163088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175541.164684:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274197760:0@lo:400:kworker.0 00000100:00100000:0.0:1789175541.164719:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274198272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175541.164769:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175541.167014:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274198016:0@lo:400:kworker.0 00000100:00100000:2.0:1789175541.167217:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198272 00000100:00100000:2.0:1789175541.167225:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198272 00000100:00100000:2.0:1789175541.167285:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789175541.167295:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274198272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175541.167332:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175541.167445:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274198272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175541.167451:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789175541.167610:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789175541.167617:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1789175541.167634:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e734376a00, transno 4294967301 00000004:00080000:1.0:1789175541.167652:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789175541.167662:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e72e18f480, transno 4294967304 00000100:00100000:1.0:1789175541.167668:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274198144:0@lo:400:kworker.0 00000100:00100000:3.0:1789175541.172494:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274197888:0@lo:400:kworker.0 00000100:00100000:2.0:1789175541.175069:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274198272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789175541.227200:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175541.239273:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1789175541.239288:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789175541.273853:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1789175541.273895:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789175541.273924:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:1.0:1789175541.273937:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789175541.273968:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:1.0:1789175541.273976:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e72673d9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789175541.273985:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7111df400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e72673d0c0 00000020:00080000:1.0:1789175541.273989:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7111df600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e70f90b400 00000020:00080000:0.0:1789175541.274003:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000001:00080000:1.0:1789175541.274008:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789175541.274183:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1789175541.274374:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175541.274396:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274198400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789175541.274481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175541.274569:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198400 00000100:00100000:1.0:1789175541.274582:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198400 00000100:00100000:1.0:1789175541.274745:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789175541.274755:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274198400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789175541.275019:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789175541.275142:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789175535 -> 1789175535 00002000:00010000:1.0:1789175541.275164:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1789175535 -> 1789175535 00002000:00010000:1.0:1789175541.275166:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789175535 -> 1789175535 00002000:00010000:1.0:1789175541.275168:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789175541.275237:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274198400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 483us (756us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789175541.275245:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789175541.276579:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789175541.276594:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1789175541.276624:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97e7075ea300 x1876086274198400/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789175557 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789175541.276637:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e7075ea300/2, rc 0, transno 4294967312 00000100:00100000:0.0:1789175541.276643:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274198400:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1789175542.242112:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175542.893479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175542.893761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123072 00000100:00100000:2.0:1789175542.893776:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123072 00000100:00100000:2.0:1789175542.893939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:2.0:1789175542.893954:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10246:x1876086251123072:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789175542.894119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10246:x1876086251123072:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 168us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175542.894129:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00080000:0.0:1789175542.898765:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175542.902956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175542.903038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123328 00000100:00100000:0.0:1789175542.903053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123328 00000100:00100000:0.0:1789175542.903132:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1789175542.903146:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:10246:x1876086251123328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789175542.903680:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+14:10246:x1876086251123328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 535us (740us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789175542.903689:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1789175542.915879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175542.915930:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175542.915973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175542.916014:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175542.916394:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123584 00000100:00100000:2.0:1789175542.916407:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123584 00000100:00100000:2.0:1789175542.916492:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123712 00000100:00100000:2.0:1789175542.916495:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123712 00000100:00100000:2.0:1789175542.916658:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1789175542.916671:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251123584:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175542.916768:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251123584:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 100us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175542.916793:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1789175542.916827:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1789175542.916835:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251123712:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175542.916862:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251123712:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175542.916868:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1789175542.917185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123840 00000100:00100000:1.0:1789175542.917191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123840 00000100:00100000:1.0:1789175542.917245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:1.0:1789175542.917253:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251123840:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175542.917288:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251123840:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 37us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175542.917295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00080000:3.0:1789175542.917942:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789175542.917950:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175542.917954:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175542.918031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123456 00000100:00100000:0.0:1789175542.918038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123456 00000100:00100000:0.0:1789175542.918107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 288 00000100:00100000:0.0:1789175542.918116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251123456:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175542.918172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251123456:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 58us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175542.918180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 288 00000100:00100000:3.0:1789175543.174702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175543.174841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251123968 00000100:00100000:2.0:1789175543.174854:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251123968 00000100:00100000:2.0:1789175543.174938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:2.0:1789175543.174952:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:11036:x1876086251123968:12345-192.168.201.18@tcp:101:lsof.0 00010000:00010000:2.0:1789175543.174981:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175543.175011:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16f66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d6d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175101:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175119:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175137:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175543.175185:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175543.175190:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175543.175243:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c16f66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175322:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175543.175331:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:2.0:1789175543.175335:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175543.175408:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:2.0:1789175543.175609:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+6:11036:x1876086251123968:12345-192.168.201.18@tcp:101:lsof.0 Request processed in 659us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175543.175618:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 136 00010000:00010000:0.0:1789175543.265911:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175544.299436:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175545.313685:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175545.442942:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175545.442956:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175545.443397:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1789175545.443406:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789175545.761678:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274198528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175545.762094:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175545.764095:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198528 00000100:00100000:2.0:1789175545.764116:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198528 00000100:00100000:2.0:1789175545.764295:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789175545.764308:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274198528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175545.764392:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175545.764501:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274198528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175545.764510:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789175545.765899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274198528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789175545.767317:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175546.273699:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274198784:0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.273820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.273937:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274198912:0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.273965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.274004:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198784 00000100:00100000:3.0:1789175546.274013:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198784 00000100:00100000:3.0:1789175546.274066:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198912 00000100:00100000:3.0:1789175546.274070:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198912 00000100:00100000:3.0:1789175546.274107:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789175546.274118:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274198784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.274193:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274198784:12345-0@lo:400:kworker.0 Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175546.274200:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789175546.274221:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789175546.274227:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274198912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.274258:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274198912:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175546.274265:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789175546.274282:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175546.274334:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274198912:0@lo:400:kworker.0 00000100:00100000:1.0:1789175546.277540:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274198656:0@lo:400:kworker.0 00000100:00100000:1.0:1789175546.277653:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.278731:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274199040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175546.278870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.278930:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274199040 00000100:00100000:3.0:1789175546.278940:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274199040 00000100:00100000:3.0:1789175546.279012:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789175546.279024:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274199040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175546.279068:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175546.279119:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274199040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175546.279127:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789175546.279184:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274199040:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789175546.279209:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175546.279936:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274198784:0@lo:400:kworker.0 00000100:00100000:1.0:1789175546.280017:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274199296:0@lo:400:kworker.0 00000100:00100000:1.0:1789175546.280063:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.282936:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274199168:0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.283035:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175546.283616:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274199168 00000100:00100000:3.0:1789175546.283634:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274199168 00000100:00100000:2.0:1789175546.285511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274198656 00000100:00100000:2.0:1789175546.285529:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274198656 00000100:00100000:2.0:1789175546.285602:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789175546.285624:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274198656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175546.285767:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274198656:12345-0@lo:400:kworker.0 Request processed in 154us (8113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175546.285775:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789175546.286105:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274199296 00000100:00100000:0.0:1789175546.286112:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274199296 00000100:00100000:0.0:1789175546.286162:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789175546.286171:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274199296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175546.286228:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876086274199296:12345-0@lo:400:kworker.0 Request processed in 59us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175546.286235:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789175546.286287:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274199296:0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.286470:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789175546.286484:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274199168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.286529:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274199168:12345-0@lo:400:kworker.0 Request processed in 51us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175546.286536:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789175546.286580:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274199168:0@lo:400:kworker.0 00000100:00100000:3.0:1789175546.286591:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274198656:0@lo:400:kworker.0 00000100:00080000:3.0:1789175546.286622:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789175546.340249:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175546.358585:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789175546.405693:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789175546.405725:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789175546.406090:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789175546.406103:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1789175547.028640:0:12254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:12:25 (1789175545) 00010000:00010000:0.0:1789175547.361910:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175548.033189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175548.033263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175548.033435:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124480 00000100:00100000:3.0:1789175548.033450:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124480 00000100:00080000:0.0:1789175548.033534:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175548.033552:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:3.0:1789175548.033567:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251124480:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175548.033697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124224 00000100:00100000:2.0:1789175548.033702:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124224 00000100:00100000:2.0:1789175548.033755:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00080000:0.0:1789175548.033762:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175548.033764:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:2354:x1876086251124224:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175548.033846:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175548.034240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124096 00000100:00100000:0.0:1789175548.034246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124096 00000100:00100000:0.0:1789175548.034297:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 290 00000100:00100000:0.0:1789175548.034307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251124096:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175548.037208:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251124480:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 3626us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175548.037242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:2.0:1789175548.038678:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+13:2354:x1876086251124224:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 4905us (5498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175548.038696:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:1.0:1789175548.040162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175548.040229:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175548.040268:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124352 00000100:00100000:3.0:1789175548.040282:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124352 00000100:00100000:2.0:1789175548.040407:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124608 00000100:00100000:2.0:1789175548.040421:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124608 00000100:00100000:2.0:1789175548.040492:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:2.0:1789175548.040504:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2354:x1876086251124608:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175548.040593:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2354:x1876086251124608:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175548.040613:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00080000:2.0:1789175548.040656:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789175548.041873:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175548.041955:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1789175548.041968:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251124352:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175548.042058:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251124352:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 93us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175548.042086:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1789175548.042985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251124096:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 8672us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175548.043002:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 290 00010000:00010000:2.0:1789175548.385898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175548.557371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175548.558166:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124864 00000100:00100000:0.0:1789175548.558196:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124864 00000100:00100000:0.0:1789175548.558306:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:0.0:1789175548.558320:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+13:11301:x1876086251124864:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175548.558376:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175548.558673:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16f74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d74 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558780:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558800:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558815:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558834:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558842:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.558850:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.560651:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16f89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561144:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16f89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561305:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16f89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175548.561326:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789175548.561865:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561876:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561884:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561890:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175548.561896:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561904:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561921:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7181cd500) 00010000:00010000:0.0:1789175548.561925:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175548.561931:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561939:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c16f7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561959:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561966:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561981:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561986:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175548.561989:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.561996:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.563242:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97e7102ec700) 00010000:00010000:0.0:1789175548.563251:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175548.563260:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.563270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16f82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.566990:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16f74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d74 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.568086:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16f89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d74 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175548.568101:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:0.0:1789175548.568105:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175548.568110:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669c00, rc 0) 00000100:00100000:0.0:1789175548.568225:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:11301:x1876086251124864:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 9907us (10886us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789175548.568253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:2.0:1789175548.577002:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175548.577415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175548.577573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125120 00000100:00100000:2.0:1789175548.577587:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125120 00000100:00100000:2.0:1789175548.577680:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175548.577695:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707446c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:2355:x1876086251125120:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175548.577716:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175548.577750:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16f89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d74 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175548.577780:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:2.0:1789175548.577788:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175548.577870:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707446c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:2355:x1876086251125120:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 177us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175548.577878:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175548.588948:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251124992 00000100:00100000:0.0:1789175548.588973:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251124992 00000100:00100000:2.0:1789175548.590775:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 138 00000100:00100000:2.0:1789175548.590797:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11301:x1876086251124992:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789175548.590972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11301:x1876086251124992:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 182us (13985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175548.590980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 138 00010000:00010000:2.0:1789175549.409673:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175549.541679:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175549.541694:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175549.541789:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1789175549.541801:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789175550.435077:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175550.716029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175550.717033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125248 00000100:00100000:1.0:1789175550.717049:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125248 00000100:00100000:1.0:1789175550.717141:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:1.0:1789175550.717156:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11343:x1876086251125248:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175550.717183:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175550.717211:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717316:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717377:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717420:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717428:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717697:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717707:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717715:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717722:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654aa00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175550.717727:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717736:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717750:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:1.0:1789175550.717754:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175550.717760:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717768:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c16f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717789:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717795:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.717801:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789175550.717923:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789175550.718056:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175550.718060:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718068:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718078:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97e721b55400) 00010000:00010000:1.0:1789175550.718082:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175550.718086:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718139:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16f97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d7b expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718152:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:1.0:1789175550.718154:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175550.718166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d7b expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.718178:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ba00, rc 0) 00000100:00100000:1.0:1789175550.718323:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11343:x1876086251125248:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1171us (2307us total) trans 0 rc 301/301 00000100:00100000:1.0:1789175550.718332:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:2.0:1789175550.731955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175550.732131:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125504 00000100:00100000:3.0:1789175550.732145:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125504 00000100:00100000:3.0:1789175550.732225:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 140 00000100:00100000:3.0:1789175550.732248:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11343:x1876086251125504:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:3.0:1789175550.732381:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175550.732419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16915 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bb4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.732456:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:3.0:1789175550.732463:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175550.732993:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.733014:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.733025:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.733071:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.733090:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 5 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175550.733109:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274199424:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175550.733233:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047600 going to sleep for 11 seconds 00000100:00100000:2.0:1789175550.736283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175550.736415:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125632 00000100:00100000:1.0:1789175550.736429:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125632 00010000:00010000:1.0:1789175550.736499:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 6 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175550.736544:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:1.0:1789175550.736558:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2353:x1876086251125632:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175550.736578:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175550.736586:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 6 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.736603:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 6 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.736632:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:1.0:1789175550.736639:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.736651:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.736659:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.736710:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175550.736954:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c16f6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d6d expref: 6 pid: 5839 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175550.736974:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274199424:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175550.737014:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.737025:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.737039:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.737070:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.737084:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.737093:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789175550.737906:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175550.739428:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251125632:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 2861us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175550.739444:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000004:00200000:2.0:1789175550.745635:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789175550.745665:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.745678:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.745687:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.745693:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175550.745699:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.745709:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.746128:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7051db100) 00010000:00010000:2.0:1789175550.746133:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175550.746139:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175550.746147:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c16fac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175550.751987:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051d5fb22 reply state 00000000665298e5 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175550.752016:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175550.752247:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+15:11343:x1876086251125504:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 19996us (20292us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789175550.752281:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 140 00010000:00010000:1.0:1789175550.760850:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760875:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760885:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760891:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175550.760897:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760906:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760926:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97e7051db200) 00010000:00010000:1.0:1789175550.760930:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175550.760937:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.760943:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c16fb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175550.843817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175550.844521:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125760 00000100:00100000:1.0:1789175550.844535:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125760 00000100:00100000:1.0:1789175550.844623:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:1.0:1789175550.844634:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+14:11352:x1876086251125760:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:1.0:1789175550.844665:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175550.844692:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d82 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844789:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844807:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844821:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175550.844862:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789175550.844865:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175550.844891:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844916:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d82 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844936:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d82 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.844945:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:1.0:1789175550.844949:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175550.844953:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a000, rc 0) 00000100:00100000:1.0:1789175550.845047:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+15:11352:x1876086251125760:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 403us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175550.845061:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:3.0:1789175550.882665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274199552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175550.882825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175550.883902:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274199552 00000100:00100000:3.0:1789175550.883917:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274199552 00000100:00100000:3.0:1789175550.884042:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789175550.884055:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274199552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175550.884106:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175550.884244:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274199552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175550.884253:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789175550.887663:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175550.887920:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789175550.887932:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e7075ea300, transno 4294967312 00000100:00100000:1.0:1789175550.887970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274199552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175550.908113:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175550.908202:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251125888 00000100:00100000:0.0:1789175550.908215:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251125888 00000100:00100000:0.0:1789175550.908329:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00100000:0.0:1789175550.908372:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+15:11358:x1876086251125888:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175550.908399:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175550.908428:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d89 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908514:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908534:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908549:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908569:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908577:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908586:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908886:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908893:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908898:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175550.908926:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789175550.908929:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175550.908949:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908960:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908966:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908971:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908975:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175550.908978:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908984:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.908994:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:0.0:1789175550.909001:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175550.909005:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909010:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c16fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909021:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909025:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909029:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909032:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175550.909033:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909037:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909040:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97e7102ec700) 00010000:00010000:0.0:1789175550.909042:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175550.909043:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909047:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c16fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909081:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c16fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d89 expref: 17 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909108:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d89 expref: 16 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.909114:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175550.909116:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789175550.909118:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669600, rc 0) 00000100:00100000:0.0:1789175550.909198:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+16:11358:x1876086251125888:12345-192.168.201.18@tcp:101:bash.0 Request processed in 859us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175550.909206:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00100000:1.0:1789175550.911166:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175550.911823:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251126144 00000100:00100000:2.0:1789175550.911835:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251126144 00000100:00100000:3.0:1789175550.911978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:3.0:1789175550.911988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+16:11358:x1876086251126144:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175550.912010:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175550.912032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16fe4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.912202:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.912221:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175550.912233:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.920843:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.920880:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.920896:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789175550.921981:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789175550.922224:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922247:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922258:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922300:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922305:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922321:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922326:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175550.922330:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922336:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922491:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175550.922496:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175550.922502:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922511:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c16feb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789175550.922527:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3cacd80 reply state 00000000624ff0fc transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175550.922537:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789175550.922578:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c16fe4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922592:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.922597:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175550.922599:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175550.922606:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175550.922694:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11358:x1876086251126144:12345-192.168.201.18@tcp:101:bash.0 Request processed in 10706us (11543us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789175550.922707:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 143 00010000:00010000:0.0:1789175550.923980:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.923998:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.924006:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.924013:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175550.924017:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.924025:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.924074:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e721b55200) 00010000:00010000:0.0:1789175550.924079:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175550.924084:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.924105:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c16ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175550.926122:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175550.926564:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251126272 00000100:00100000:0.0:1789175550.926577:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251126272 00000100:00080000:1.0:1789175550.926633:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175550.926671:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1789175550.926683:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251126272:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175550.926703:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175550.926727:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d97 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175550.926763:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175550.926789:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1789175550.926794:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175550.926804:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.926924:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.926937:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668a00, rc 0) 00000100:00100000:0.0:1789175550.927020:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251126272:12345-192.168.201.18@tcp:101:bash.0 Request processed in 340us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175550.927025:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1789175550.929026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175550.929155:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251126400 00000100:00100000:2.0:1789175550.929165:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251126400 00000100:00100000:3.0:1789175550.929278:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1789175550.929291:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+6:11358:x1876086251126400:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175550.929311:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175550.929329:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2d9e expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.929602:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.929629:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175550.929633:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175550.929637:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 7 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.929677:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.929689:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175550.929703:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12165:1876086274199680:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175550.929808:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175550.931776:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12165:1876086274199680:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175550.931885:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 7 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175550.931913:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8000, rc 0) 00000100:00100000:2.0:1789175550.932141:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175550.932180:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:11358:x1876086251126400:12345-192.168.201.18@tcp:101:bash.0 Request processed in 2892us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175550.932190:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1789175550.932444:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251126528 00000100:00100000:1.0:1789175550.932452:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251126528 00010000:00010000:1.0:1789175550.932493:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175550.932523:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1789175550.932533:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251126528:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175550.932549:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175550.932577:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.932592:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.932620:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17007 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d97 expref: 7 pid: 6686 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.932636:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175550.932640:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175550.932649:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.932682:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175550.933288:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175550.933306:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274199808:192.168.201.18@tcp:105: 00000100:00100000:1.0:1789175550.933711:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546300 going to sleep for 11 seconds 00000100:00100000:2.0:1789175550.936085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175550.936085:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1876086274199808:192.168.201.18@tcp:105: 00010000:00010000:1.0:1789175550.936118:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175550.936247:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251126784 00000100:00100000:0.0:1789175550.936258:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251126784 00000100:00100000:0.0:1789175550.936375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1789175550.936561:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11358:x1876086251126784:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1789175550.936998:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251126528:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 4464us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175550.937007:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1789175550.937051:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11358:x1876086251126784:12345-192.168.201.18@tcp:35:bash.0 Request processed in 496us (979us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789175550.937056:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:3.0:1789175551.009124:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.009251:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251127040 00000100:00100000:0.0:1789175551.009269:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251127040 00000100:00100000:2.0:1789175551.009892:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:2.0:1789175551.009914:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11368:x1876086251127040:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175551.009955:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175551.009996:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2da5 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175551.010130:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789175551.010303:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17015 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2da5 expref: 21 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.010322:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:2.0:1789175551.010325:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175551.010362:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2da5 expref: 21 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.010381:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4000, rc 0) 00000100:00100000:2.0:1789175551.010468:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11368:x1876086251127040:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 561us (1355us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1789175551.010496:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:2.0:1789175551.014457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.014597:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251127296 00000100:00100000:0.0:1789175551.014609:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251127296 00000100:00100000:0.0:1789175551.014667:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:0.0:1789175551.014676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11368:x1876086251127296:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175551.014937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+21:11368:x1876086251127296:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 261us (497us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789175551.015046:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175551.087001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175551.087539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251127424 00000100:00100000:3.0:1789175551.087554:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251127424 00000100:00100000:2.0:1789175551.087781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:2.0:1789175551.087796:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+21:11374:x1876086251127424:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175551.087830:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175551.087860:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dac expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.087966:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.087983:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.087999:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175551.088041:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789175551.088058:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175551.088084:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.088118:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dac expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.088142:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dac expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.088648:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175551.088651:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175551.088657:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4a00, rc 0) 00000100:00100000:2.0:1789175551.088832:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11374:x1876086251127424:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1035us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.088843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:3.0:1789175551.096172:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.096590:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251127680 00000100:00100000:1.0:1789175551.096605:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251127680 00000100:00100000:1.0:1789175551.096687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:1.0:1789175551.096699:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11374:x1876086251127680:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175551.096727:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.096757:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c17031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2db3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.096888:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.096929:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.096945:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175551.096962:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789175551.097154:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c17031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2db3 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.097179:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2db3 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.097190:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175551.097192:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175551.097198:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ba00, rc 0) 00000100:00100000:1.0:1789175551.097611:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11374:x1876086251127680:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 911us (1469us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789175551.097620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:3.0:1789175551.104025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175551.104085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.104159:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128064 00000100:00100000:0.0:1789175551.104183:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128064 00000100:00100000:0.0:1789175551.104281:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1789175551.104293:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+24:2353:x1876086251128064:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175551.104317:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175551.104383:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2db3 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.104408:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:0.0:1789175551.104415:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175551.104629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251127936 00000100:00100000:1.0:1789175551.104635:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251127936 00000100:00100000:1.0:1789175551.104675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:1.0:1789175551.104683:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11374:x1876086251127936:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175551.104709:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.104728:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.104885:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.104901:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.104914:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175551.104928:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789175551.105098:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dba expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.105118:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dba expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.105126:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:1.0:1789175551.105129:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789175551.105132:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:0.0:1789175551.105543:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+26:2353:x1876086251128064:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1248us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175551.105555:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1789175551.105780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11374:x1876086251127936:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1096us (1770us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789175551.105788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:3.0:1789175551.116501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.116783:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128192 00000100:00100000:2.0:1789175551.116796:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128192 00000100:00100000:2.0:1789175551.116875:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:2.0:1789175551.116887:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251128192:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:2.0:1789175551.116945:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.116970:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.116981:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789175551.116986:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175551.116991:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.117036:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.117054:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 6 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.117089:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274199936:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175551.117208:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175551.121488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175551.121670:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274199936:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175551.121707:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175551.121915:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128320 00000100:00100000:1.0:1789175551.121925:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128320 00002000:00100000:1.0:1789175551.121987:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97e7075ebb80 x1876086251128320/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:722/0 lens 504/0 e 0 to 0 dl 1789175562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789175551.121998:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7075ebb80 with x1876086251128320 ext(0->12) 00010000:00010000:1.0:1789175551.122015:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 7 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.122031:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 7 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789175551.122039:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e7075ebb80 00000100:00100000:1.0:1789175551.122080:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1789175551.122090:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251128320:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:1.0:1789175551.122772:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251128320:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 678us (1297us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789175551.122782:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:1.0:1789175551.122791:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97e7075ebb80 x1876086251128320/t4294967305(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:722/0 lens 504/448 e 0 to 0 dl 1789175562 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789175551.122800:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e7075ebb80 with x1876086251128320 ext(0->12) 00010000:00010000:1.0:1789175551.122807:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.122823:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789175551.122830:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e7075ebb80 00000100:00100000:3.0:1789175551.126492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.126657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128448 00000100:00100000:2.0:1789175551.126671:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128448 00010000:00010000:2.0:1789175551.126728:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.126784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1789175551.126796:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2355:x1876086251128448:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175551.126816:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789175551.126845:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789175551.126848:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789175551 00002000:00010000:2.0:1789175551.126851:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789175551 00002000:00010000:2.0:1789175551.126853:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789175551 00010000:00010000:2.0:1789175551.126861:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.126878:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.126912:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567a76f4/0x1112cdeac4c1700e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d9e expref: 9 pid: 12165 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.126958:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175551.126964:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175551.126972:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.126985:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.127027:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175551.127106:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2355:x1876086251128448:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 311us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.127114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00010000:00010000:3.0:1789175551.127623:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127634:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127667:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127677:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127685:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127693:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175551.127698:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127708:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127724:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.127747:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081304c6e/0x1112cdeac4c1705b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175551.127841:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251128192:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 10954us (11356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175551.127852:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1789175551.132091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.132252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128704 00000100:00100000:0.0:1789175551.132265:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128704 00000100:00100000:2.0:1789175551.132800:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1789175551.132819:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11374:x1876086251128704:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:2.0:1789175551.132918:0:11956:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dba expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789175551.133295:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789175551.133694:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789175551.134992:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1789175551.135858:0:11956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.135887:0:11956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.135916:0:11956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.135969:0:11956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.135989:0:11956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 29 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.136007:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075e8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274200064:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175551.136253:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789175551.139740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.139825:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128832 00000100:00100000:0.0:1789175551.139840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128832 00010000:00010000:0.0:1789175551.139905:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 30 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175551.139958:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1789175551.139971:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+30:2353:x1876086251128832:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175551.139990:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175551.139999:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 30 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.140015:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 30 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.140044:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:0.0:1789175551.140063:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.140075:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.140085:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175551.140110:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175551.140535:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+30:2353:x1876086251128832:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 563us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175551.140546:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00010000:00010000:1.0:1789175551.140684:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c16ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d90 expref: 29 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175551.140705:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075e8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274200064:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175551.140742:0:11956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.140754:0:11956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.140761:0:11956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175551.140944:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1789175551.141691:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789175551.141848:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274200192:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789175551.141954:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175551.142002:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7147d0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175551.142521:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200192 00000100:00100000:2.0:1789175551.142531:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200192 00000100:00100000:2.0:1789175551.142612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789175551.142624:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274200192:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789175551.142730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274200192:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 108us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.142738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789175551.142789:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274200192:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789175551.143658:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789175551.143757:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274200320:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789175551.143814:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175551.143859:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200320 00000100:00100000:2.0:1789175551.143864:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200320 00000100:00100000:2.0:1789175551.143906:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789175551.143915:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274200320:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789175551.144077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11956:x1876086274200320:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 164us (263us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789175551.144085:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789175551.144110:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72673dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175551.144139:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274200320:0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:0.0:1789175551.144461:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789175551.144655:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789175551.144705:0:11956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144716:0:11956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144724:0:11956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144730:0:11956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175551.144736:0:11956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144745:0:11956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144765:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:2.0:1789175551.144768:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789175551.144774:0:11956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.144782:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17062 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175551.145012:0:11956:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789175551.146904:0:11956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789175551.146931:0:11956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336105589280ns, next at 337105584836ns, rc = 0 00000001:00080000:2.0:1789175551.146950:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789175551.147037:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55d00) 00010000:00010000:2.0:1789175551.147042:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789175551.147055:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1704d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dba expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.147371:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11374:x1876086251128704:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 14558us (15292us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789175551.147383:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000020:00080000:2.0:1789175551.147391:0:11956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789175551.150124:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.150287:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251128960 00000100:00100000:1.0:1789175551.150300:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251128960 00000100:00100000:1.0:1789175551.150672:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:1.0:1789175551.150686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11374:x1876086251128960:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175551.150721:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.150749:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c17069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dc1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.150836:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c17069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dc1 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.150855:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c17069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dc1 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.150880:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175551.150901:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175551.150906:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175551.150989:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:11374:x1876086251128960:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 305us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175551.150997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:0.0:1789175551.153855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175551.153957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251129216 00000100:00100000:3.0:1789175551.153969:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251129216 00000100:00100000:3.0:1789175551.154033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1789175551.154044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+33:11374:x1876086251129216:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175551.154437:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11374:x1876086251129216:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 393us (594us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789175551.154446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1789175551.237899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.238041:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251129472 00000100:00100000:1.0:1789175551.238057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251129472 00000100:00100000:1.0:1789175551.238149:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:1.0:1789175551.238173:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11384:x1876086251129472:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175551.238211:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.238250:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dc8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175551.238548:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789175551.238726:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17070 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dc8 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.238743:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:1.0:1789175551.238747:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789175551.238753:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dc8 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.238771:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:1.0:1789175551.238843:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11384:x1876086251129472:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 682us (962us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1789175551.238852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:3.0:1789175551.243089:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.243219:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251129600 00000100:00100000:2.0:1789175551.243242:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251129600 00000100:00100000:2.0:1789175551.243316:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:2.0:1789175551.243328:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11384:x1876086251129600:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1789175551.243488:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243509:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243525:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243544:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243574:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243582:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243725:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243734:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243742:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175551.243801:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243818:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243826:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243833:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243841:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175551.243847:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243857:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243878:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175551.243882:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175551.243888:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243895:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1707e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243912:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243918:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243924:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243929:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175551.243932:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243939:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243948:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd200) 00010000:00010000:2.0:1789175551.243950:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175551.243953:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243960:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243992:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.243999:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.244005:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.244011:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175551.244014:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.244021:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.244029:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175551.244031:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175551.244034:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.244040:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c1708c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.244161:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11384:x1876086251129600:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 832us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.244171:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:0.0:1789175551.247560:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.247766:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251129856 00000100:00100000:2.0:1789175551.247781:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251129856 00000100:00100000:2.0:1789175551.247857:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1789175551.247886:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11384:x1876086251129856:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175551.248219:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11384:x1876086251129856:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 333us (675us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789175551.248227:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:3.0:1789175551.288053:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.288152:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251130112 00000100:00100000:1.0:1789175551.288198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251130112 00000100:00100000:1.0:1789175551.288290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:1.0:1789175551.288303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11387:x1876086251130112:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175551.288388:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.288428:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288559:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288578:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288601:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288619:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288626:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288632:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288794:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288804:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.288819:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175551.288850:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789175551.289020:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289029:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289037:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289052:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175551.289058:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289068:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289089:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175551.289093:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175551.289107:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289115:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c1709a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289137:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289143:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289167:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289172:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654aa00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175551.289175:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289182:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289196:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e721b55500) 00010000:00010000:1.0:1789175551.289199:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175551.289202:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289208:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289283:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289300:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.289307:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175551.289309:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175551.289311:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ba00, rc 0) 00000100:00100000:1.0:1789175551.289454:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11387:x1876086251130112:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1151us (1413us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789175551.289472:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:0.0:1789175551.296399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.296943:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251130240 00000100:00100000:2.0:1789175551.296959:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251130240 00000100:00100000:2.0:1789175551.297110:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:2.0:1789175551.297123:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11387:x1876086251130240:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1789175551.300810:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300846:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300864:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300908:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300917:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300926:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300932:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175551.300938:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.300974:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.301092:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175551.301097:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175551.301104:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.301112:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.301327:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11387:x1876086251130240:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 4200us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.302638:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:3.0:1789175551.304761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.306315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251130496 00000100:00100000:0.0:1789175551.306335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251130496 00000100:00100000:0.0:1789175551.306446:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1789175551.306460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11387:x1876086251130496:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175551.306827:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+39:11387:x1876086251130496:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 368us (2080us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789175551.306836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:2.0:1789175551.396165:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274200832:0@lo:400:kworker.0 00000100:00100000:2.0:1789175551.396279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175551.396405:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175551.396413:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274200704:0@lo:400:kworker.0 00000100:00100000:2.0:1789175551.396448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175551.396487:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200832 00000100:00100000:2.0:1789175551.396497:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200832 00000100:00100000:2.0:1789175551.396567:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789175551.396579:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274200832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175551.396643:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274200832:12345-0@lo:400:kworker.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.396650:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789175551.396704:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274200832:0@lo:400:kworker.0 00000100:00100000:2.0:1789175551.396757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200704 00000100:00100000:2.0:1789175551.396761:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200704 00000100:00100000:2.0:1789175551.397127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789175551.397138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274200704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175551.397265:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274200448:0@lo:400:kworker.0 00000100:00100000:0.0:1789175551.397313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175551.397380:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274200960:0@lo:400:kworker.0 00000100:00100000:0.0:1789175551.397405:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175551.397428:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175551.397434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274200576:0@lo:400:kworker.0 00000100:00100000:0.0:1789175551.397456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175551.397655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200448 00000100:00100000:3.0:1789175551.397662:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200448 00000100:00100000:3.0:1789175551.397694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789175551.397701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274200448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175551.397755:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274200448:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175551.397777:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789175551.397902:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274201088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175551.397935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175551.397967:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274201088 00000100:00100000:3.0:1789175551.397971:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274201088 00000100:00100000:3.0:1789175551.398000:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789175551.398007:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274201088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175551.398027:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175551.398068:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274201088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175551.398075:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789175551.398666:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274201088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175551.413539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200960 00000100:00100000:1.0:1789175551.413569:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200960 00000100:00100000:1.0:1789175551.413669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274200576 00000100:00100000:1.0:1789175551.413673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274200576 00000100:00100000:1.0:1789175551.413701:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789175551.415892:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274200960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175551.416024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274200960:12345-0@lo:400:kworker.0 Request processed in 162us (18617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175551.416032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789175551.416080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789175551.416087:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274200576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175551.416117:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274200576:12345-0@lo:400:kworker.0 Request processed in 31us (18660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175551.416122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1789175551.416314:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175551.416388:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274200576:0@lo:400:kworker.0 00000100:00100000:1.0:1789175551.416403:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274200448:0@lo:400:kworker.0 00000100:00100000:1.0:1789175551.416415:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789175551.416665:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274200704:12345-0@lo:400:kworker.0 Request processed in 19528us (20215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.416674:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789175551.418554:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274200704:0@lo:400:kworker.0 00010000:00010000:1.0:1789175551.458279:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789175551.475390:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000004:00080000:3.0:1789175551.475442:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789175551.475469:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e72673dcc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789175551.475476:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e73fbd0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e72673d000 00000020:00080000:3.0:1789175551.475479:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e73fbd0800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e734343800 00000020:00080000:0.0:1789175551.475557:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789175551.475798:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789175551.476060:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274201216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789175551.476179:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175551.476401:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274201216 00000100:00100000:1.0:1789175551.476412:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274201216 00000100:00100000:1.0:1789175551.476492:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175551.476506:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274201216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789175551.476548:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1789175551.476617:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4a6ff, atime: 0x6aa4a6ff, ctime: 0x6aa4a6ff, blocks: 0x1 00010000:00010000:1.0:1789175551.476627:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.476650:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1789175551.476655:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175551.476664:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.476682:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.476694:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.476704:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.476725:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789175551.477452:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876086274201216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 944us (1269us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789175551.477463:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789175551.477784:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e73c011180/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789175551.477793:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274201216:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789175551.478074:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175551.478085:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.478099:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175551.478105:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.478117:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.478141:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.478149:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4ce25a/0x1112cdeac4c170bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.478186:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175551.478188:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175551.478190:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175551.611622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.613318:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251130752 00000100:00100000:1.0:1789175551.613338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251130752 00000100:00100000:1.0:1789175551.613497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:1.0:1789175551.613512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+17:11418:x1876086251130752:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:1.0:1789175551.613564:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.613614:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2dd6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.613759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c170cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.613777:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c170cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.613791:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c170cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175551.613808:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789175551.614126:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dd6 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.614149:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c170cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dd6 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.614493:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175551.614497:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175551.614502:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a200, rc 0) 00000100:00100000:1.0:1789175551.614611:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11418:x1876086251130752:12345-192.168.201.18@tcp:101:cat.0 Request processed in 1102us (3006us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789175551.614621:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:3.0:1789175551.618022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175551.618088:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175551.620410:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251131136 00000100:00100000:0.0:1789175551.620431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251131136 00000100:00100000:0.0:1789175551.620540:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1789175551.620554:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11418:x1876086251131136:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:0.0:1789175551.620920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11418:x1876086251131136:12345-192.168.201.18@tcp:35:cat.0 Request processed in 368us (2830us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789175551.620930:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1789175551.621087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251130880 00000100:00100000:2.0:1789175551.621093:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251130880 00000100:00100000:2.0:1789175551.621140:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1789175551.621150:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:2354:x1876086251130880:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175551.621170:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175551.621202:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c170cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dd6 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.621237:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175551.621246:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175551.621271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2354:x1876086251130880:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 123us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175551.621278:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175551.693250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175551.693406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251131392 00000100:00100000:1.0:1789175551.693420:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251131392 00000100:00100000:1.0:1789175551.693498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:1.0:1789175551.693513:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11424:x1876086251131392:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1789175551.693569:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175551.693573:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789175551.693610:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c1702a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dac expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693635:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175551.693642:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789175551.693673:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ddd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693803:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693818:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693828:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693867:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.693883:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 19 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175551.693899:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274201344:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175551.694014:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baad000 going to sleep for 11 seconds 00000100:00100000:1.0:1789175551.697507:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.697668:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274201344:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175551.697719:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175551.701019:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251131520 00000100:00100000:3.0:1789175551.701044:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251131520 00010000:00010000:3.0:1789175551.701229:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 20 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175551.701525:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1789175551.701538:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707444850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+20:2353:x1876086251131520:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175551.701570:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175551.701579:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 20 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701596:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 20 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701744:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c170a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dcf expref: 20 pid: 5839 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701769:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175551.701776:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701789:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701798:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175551.701847:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175551.702076:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707444850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2353:x1876086251131520:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 539us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175551.702085:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00010000:00010000:2.0:1789175551.702827:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.702841:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175551.702868:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789175551.703082:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c170d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.703106:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.703132:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175551.703136:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175551.703141:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:2.0:1789175551.703215:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11424:x1876086251131392:12345-192.168.201.18@tcp:101:dd.0 Request processed in 9705us (9977us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789175551.703234:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:1.0:1789175551.713771:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175551.713978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251131776 00000100:00100000:2.0:1789175551.713992:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251131776 00000100:00100000:2.0:1789175551.714135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:2.0:1789175551.714159:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11424:x1876086251131776:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:2.0:1789175551.714627:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.714650:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175551.714665:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789175551.714728:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1789175551.714766:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a8427f reply state 0000000097e292ee transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175551.714778:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175551.714900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11424:x1876086251131776:12345-192.168.201.18@tcp:36:dd.0 Request processed in 752us (1143us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789175551.714909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 155 00000020:00080000:2.0:1789175551.714933:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789175551.716788:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716809:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716818:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716824:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175551.716830:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716840:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716862:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:1.0:1789175551.716865:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175551.716872:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175551.716880:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c170ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789175552.029435:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789175552.029461:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1789175552.063472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.063869:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251131904 00000100:00100000:2.0:1789175552.063885:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251131904 00000100:00100000:2.0:1789175552.063994:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:2.0:1789175552.064009:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:11438:x1876086251131904:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:2.0:1789175552.064041:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175552.064069:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c170f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2de4 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064152:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064172:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064190:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064208:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064226:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.064234:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.065078:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.065111:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.065120:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.065170:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.065189:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 22 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175552.065206:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274201472:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175552.065403:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546600 going to sleep for 11 seconds 00000100:00080000:1.0:1789175552.065999:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175552.068180:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274201472:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175552.068234:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175552.069132:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.069257:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251132160 00000100:00100000:2.0:1789175552.069267:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251132160 00000100:00100000:2.0:1789175552.069601:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1789175552.069614:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+23:5593:x1876086251132160:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789175552.070041:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:5593:x1876086251132160:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 427us (911us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789175552.070050:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1789175552.071903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.072176:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251132288 00000100:00100000:2.0:1789175552.072194:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251132288 00010000:00010000:2.0:1789175552.072247:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 24 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175552.072295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:2.0:1789175552.072305:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:2354:x1876086251132288:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175552.072323:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175552.072331:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 24 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072509:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 24 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072550:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c170e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ddd expref: 24 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072572:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.072579:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072591:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072600:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.072648:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175552.072892:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+23:2354:x1876086251132288:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 587us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.072912:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00010000:00010000:3.0:1789175552.073457:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073480:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175552.073551:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789175552.073558:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789175552.073592:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073610:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073621:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073639:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073646:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073652:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175552.073657:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073666:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073680:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:3.0:1789175552.073683:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175552.073688:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073717:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c170fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073732:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073739:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073745:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073750:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175552.073754:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073761:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073770:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cde00) 00010000:00010000:3.0:1789175552.073772:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175552.073775:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073781:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073829:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c170f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2de4 expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073845:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2de4 expref: 22 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.073859:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175552.073862:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175552.073864:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:3.0:1789175552.073915:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11438:x1876086251131904:12345-192.168.201.18@tcp:101:stat.0 Request processed in 9911us (10461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175552.073924:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:1.0:1789175552.140809:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.140932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251132544 00000100:00100000:0.0:1789175552.140947:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251132544 00000100:00100000:0.0:1789175552.141031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00100000:0.0:1789175552.141044:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11444:x1876086251132544:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:0.0:1789175552.141122:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175552.141166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1710a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2de4 expref: 22 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.141190:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175552.141198:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175552.141859:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.141878:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.141891:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175552.141960:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1789175552.142006:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf022be3 reply state 0000000069c3d78d transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175552.142016:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175552.142314:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11444:x1876086251132544:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 1269us (1516us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789175552.142324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 157 00000020:00080000:0.0:1789175552.142330:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789175552.146959:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.146983:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.146992:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.146999:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175552.147005:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.147015:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.147037:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175552.147040:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175552.147058:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.147066:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17111 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175552.281892:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.282627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251132672 00000100:00100000:0.0:1789175552.282664:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251132672 00000100:00100000:0.0:1789175552.282878:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:0.0:1789175552.282892:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+23:11458:x1876086251132672:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:0.0:1789175552.282927:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175552.282956:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2deb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283813:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283838:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283878:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283887:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.283894:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284613:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284627:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284636:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175552.284782:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789175552.284788:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175552.284819:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284835:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284845:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284852:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284860:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284866:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175552.284871:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284881:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284896:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175552.284900:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175552.284905:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284912:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1711f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284938:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284945:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284952:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284957:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175552.284960:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284967:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284976:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ec300) 00010000:00010000:0.0:1789175552.284979:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175552.284982:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.284988:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17126 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.285037:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.285241:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.285265:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175552.285268:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175552.285271:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:0.0:1789175552.285646:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11458:x1876086251132672:12345-192.168.201.18@tcp:101:stat.0 Request processed in 2755us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175552.285657:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:1.0:1789175552.385666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.385856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251132928 00000100:00100000:2.0:1789175552.385870:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251132928 00000100:00100000:2.0:1789175552.385956:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:2.0:1789175552.385970:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11468:x1876086251132928:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175552.385997:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175552.386026:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2df2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175552.386186:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789175552.386718:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17134 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df2 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.386739:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:2.0:1789175552.386742:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175552.386749:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df2 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.386768:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175552.386855:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11468:x1876086251132928:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 889us (1204us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1789175552.386864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:0.0:1789175552.395927:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.396023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251133184 00000100:00100000:3.0:1789175552.396038:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251133184 00000100:00100000:3.0:1789175552.396220:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1789175552.396233:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11468:x1876086251133184:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175552.396925:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11468:x1876086251133184:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 689us (1014us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789175552.396935:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1789175552.464676:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.464911:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251133440 00000100:00100000:2.0:1789175552.464926:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251133440 00000100:00100000:2.0:1789175552.465010:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:2.0:1789175552.465023:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11474:x1876086251133440:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175552.465082:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175552.465112:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17142 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2df9 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.465737:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.465762:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.465773:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.465824:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.465841:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 27 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175552.465859:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274201600:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175552.465998:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546300 going to sleep for 11 seconds 00000100:00100000:2.0:1789175552.469200:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274201600:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175552.469247:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175552.470445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.470576:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251133568 00000100:00100000:0.0:1789175552.470587:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251133568 00010000:00010000:0.0:1789175552.470637:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 28 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175552.470682:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:0.0:1789175552.470693:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+28:2354:x1876086251133568:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175552.470711:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175552.470719:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 28 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470733:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 28 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470759:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c1712d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2deb expref: 28 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470779:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175552.470800:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470812:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470822:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.470861:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175552.470933:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:2354:x1876086251133568:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 240us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175552.470940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00010000:00010000:2.0:1789175552.471169:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.471178:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175552.471222:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789175552.471483:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17142 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 28 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.471505:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 27 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.471514:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.471517:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175552.471520:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4e00, rc 0) 00000100:00100000:2.0:1789175552.471556:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+27:11474:x1876086251133440:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6537us (6899us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789175552.471563:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:1.0:1789175552.478580:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.478745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251133824 00000100:00100000:0.0:1789175552.478759:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251133824 00000100:00100000:0.0:1789175552.478835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1789175552.478848:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:11474:x1876086251133824:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1789175552.479228:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.479252:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.479267:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175552.479335:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1789175552.479410:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add60eea reply state 00000000f53d310c transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175552.479421:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175552.479562:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+30:11474:x1876086251133824:12345-192.168.201.18@tcp:36:bash.0 Request processed in 715us (996us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789175552.479572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000020:00080000:0.0:1789175552.479578:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175552.481697:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175552.485808:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485836:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485844:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485851:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.485857:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485866:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485909:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.485913:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.485919:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.485927:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17157 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175552.488594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.489277:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251133952 00000100:00100000:0.0:1789175552.489296:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251133952 00000100:00100000:0.0:1789175552.489892:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:0.0:1789175552.489909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11474:x1876086251133952:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175552.489942:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175552.489971:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1715e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e00 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.490126:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.490151:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 30 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.490161:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.490206:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 30 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.490234:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 30 pid: 8054 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175552.490250:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274201728:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175552.490395:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789175552.493738:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274201728:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175552.493780:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175552.495813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.496368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251134080 00000100:00100000:2.0:1789175552.496383:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251134080 00010000:00010000:2.0:1789175552.496603:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 31 pid: 8054 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175552.496658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1789175552.496670:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+31:2353:x1876086251134080:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175552.496691:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175552.496698:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 31 pid: 8054 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496713:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 31 pid: 8054 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496742:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17149 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2df9 expref: 31 pid: 8054 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496761:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.496768:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496799:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496808:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.496847:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175552.496921:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+30:2353:x1876086251134080:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 253us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.496931:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00010000:00010000:0.0:1789175552.497006:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.497015:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175552.497087:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789175552.497092:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175552.497120:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.497368:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1715e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e00 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.497389:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e00 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.497397:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:0.0:1789175552.497400:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175552.497403:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668000, rc 0) 00000100:00100000:0.0:1789175552.497549:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11474:x1876086251133952:12345-192.168.201.18@tcp:101:bash.0 Request processed in 7644us (8970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175552.497557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:1.0:1789175552.501787:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.501908:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251134336 00000100:00100000:2.0:1789175552.501923:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251134336 00000100:00100000:2.0:1789175552.501996:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:2.0:1789175552.502009:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11474:x1876086251134336:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1789175552.502660:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+30:11474:x1876086251134336:12345-192.168.201.18@tcp:35:bash.0 Request processed in 651us (886us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789175552.502670:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1789175552.569587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.569660:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251134592 00000100:00100000:0.0:1789175552.569680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251134592 00000100:00100000:0.0:1789175552.569777:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1789175552.569804:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+30:11484:x1876086251134592:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175552.569838:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175552.569861:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1716c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e07 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175552.569968:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789175552.570118:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1716c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e07 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.570140:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:0.0:1789175552.570143:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175552.570148:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1716c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e07 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.570162:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669a00, rc 0) 00000100:00100000:0.0:1789175552.570239:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11484:x1876086251134592:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 436us (667us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1789175552.570247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:1.0:1789175552.573066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.573299:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251134720 00000100:00100000:2.0:1789175552.573311:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251134720 00000100:00100000:2.0:1789175552.573943:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:2.0:1789175552.573958:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11484:x1876086251134720:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1789175552.574070:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574094:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574109:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574156:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574165:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574173:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574973:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574986:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.574992:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175552.575045:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575060:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575069:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575077:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575083:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.575088:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575104:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575119:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175552.575122:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.575129:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575147:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1717a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575163:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575169:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575175:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575179:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.575181:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575187:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575194:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd200) 00010000:00010000:2.0:1789175552.575197:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.575199:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575225:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575243:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575249:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575255:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575259:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.575262:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575268:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575275:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.575277:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.575280:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.575286:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c17188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175552.576841:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11484:x1876086251134720:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 1473us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.576858:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:1.0:1789175552.578588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.578682:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251134976 00000100:00100000:3.0:1789175552.578695:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251134976 00000100:00100000:3.0:1789175552.578767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:3.0:1789175552.578780:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11484:x1876086251134976:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175552.579662:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11484:x1876086251134976:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 877us (1238us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789175552.579674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1789175552.629421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.629696:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251135232 00000100:00100000:2.0:1789175552.629710:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251135232 00000100:00100000:2.0:1789175552.629844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:2.0:1789175552.629857:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11487:x1876086251135232:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175552.629891:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175552.629922:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c1718f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e0e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630072:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630089:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630105:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630133:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630146:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630153:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c171a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c171a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.630852:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c171a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175552.630866:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789175552.630991:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631000:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631008:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631015:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.631021:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631030:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631046:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175552.631049:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.631055:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631062:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631077:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631083:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631097:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631103:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.631106:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631113:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631563:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd200) 00010000:00010000:2.0:1789175552.631569:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.631573:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631581:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c1719d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631647:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c1718f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e0e expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631663:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c171a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e0e expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.631670:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.631672:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175552.631675:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5000, rc 0) 00000100:00100000:2.0:1789175552.631776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11487:x1876086251135232:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1920us (2370us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789175552.631796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:1.0:1789175552.634781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175552.634940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.635300:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251135360 00000100:00100000:3.0:1789175552.635313:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251135360 00000100:00100000:3.0:1789175552.635664:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1789175552.635676:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+34:2355:x1876086251135360:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175552.635719:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175552.635753:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c171a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e0e expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.635777:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175552.635783:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175552.635857:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+33:2355:x1876086251135360:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 183us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175552.635865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1789175552.636561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251135488 00000100:00100000:0.0:1789175552.636571:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251135488 00000100:00100000:3.0:1789175552.636703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:3.0:1789175552.636713:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:11487:x1876086251135488:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175552.636795:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636813:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636824:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636859:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636867:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636874:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636896:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175552.636902:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636910:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636921:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175552.636925:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175552.636930:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.636936:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175552.637001:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:11487:x1876086251135488:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 289us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175552.637008:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:1.0:1789175552.639118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.639220:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251135744 00000100:00100000:3.0:1789175552.639231:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251135744 00000100:00100000:3.0:1789175552.639300:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1789175552.639312:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+33:11487:x1876086251135744:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175552.639841:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11487:x1876086251135744:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 529us (734us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789175552.639850:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1789175552.851968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.852104:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136000 00000100:00100000:3.0:1789175552.852118:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136000 00000100:00100000:3.0:1789175552.852229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:3.0:1789175552.852261:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11505:x1876086251136000:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1789175552.852485:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175552.852515:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e15 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.852678:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c171c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.852700:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c171c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.852715:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c171c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789175552.852730:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789175552.852944:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c171b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e15 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.852975:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c171c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e15 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175552.852985:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:3.0:1789175552.852989:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789175552.852993:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9c00, rc 0) 00000100:00100000:3.0:1789175552.853149:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11505:x1876086251136000:12345-192.168.201.18@tcp:101:cat.0 Request processed in 889us (1194us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789175552.853164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:1.0:1789175552.881162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175552.881406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136128 00000100:00100000:0.0:1789175552.881419:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136128 00000100:00100000:0.0:1789175552.881492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:0.0:1789175552.881505:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11506:x1876086251136128:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175552.881538:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175552.881568:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c171ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881670:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881684:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881748:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175552.881789:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789175552.881792:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175552.881858:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881883:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c171ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e1c expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881901:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e1c expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175552.881908:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175552.881910:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175552.881913:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668600, rc 0) 00000100:00100000:0.0:1789175552.882021:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11506:x1876086251136128:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 519us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175552.882026:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:1.0:1789175552.885058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175552.885216:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136512 00000100:00100000:3.0:1789175552.885228:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136512 00000100:00100000:2.0:1789175552.885534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1789175552.885547:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11506:x1876086251136512:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175552.886061:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11506:x1876086251136512:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 515us (1025us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789175552.886072:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1789175552.891841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.892381:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136640 00000100:00100000:2.0:1789175552.892395:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136640 00000100:00100000:2.0:1789175552.892486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1789175552.892499:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11506:x1876086251136640:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:2.0:1789175552.892525:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789175552.892567:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e00 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.892593:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9c00/0x1112cdeac4c171c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e15 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.892607:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c17069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2dc1 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.892619:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e721b55a00) 00010000:00010000:2.0:1789175552.892643:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175552.892720:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11506:x1876086251136640:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 224us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.892728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1789175552.896518:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.896802:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136768 00000100:00100000:2.0:1789175552.896819:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136768 00000100:00100000:2.0:1789175552.896899:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:2.0:1789175552.896912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11506:x1876086251136768:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:2.0:1789175552.897096:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.897118:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.897132:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789175552.897768:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789175552.897956:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11506:x1876086251136768:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1042us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.897966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:1.0:1789175552.934597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175552.934742:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251136896 00000100:00100000:2.0:1789175552.934755:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251136896 00000100:00100000:2.0:1789175552.935157:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:2.0:1789175552.935180:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11508:x1876086251136896:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175552.935235:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175552.935264:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e23 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935409:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935429:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935462:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935480:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935489:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.935497:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936138:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936152:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936160:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175552.936222:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789175552.936229:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175552.936256:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936281:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936293:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936312:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936861:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936874:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.936881:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936891:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936909:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175552.936912:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.936918:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936925:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c171ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936943:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936950:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936957:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936963:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175552.936977:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936984:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.936992:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd300) 00010000:00010000:2.0:1789175552.936994:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175552.936998:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.937004:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c171f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.937056:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 37 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.937072:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 36 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175552.937081:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:2.0:1789175552.937083:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175552.937086:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5800, rc 0) 00000100:00100000:2.0:1789175552.937197:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11508:x1876086251136896:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2027us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175552.937217:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:3.0:1789175553.155695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.156299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.156371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.156412:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.156450:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137408 00000100:00100000:3.0:1789175553.156463:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137408 00000100:00100000:3.0:1789175553.156553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:3.0:1789175553.156567:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251137408:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175553.156667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2354:x1876086251137408:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175553.156676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00080000:3.0:1789175553.156701:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175553.157180:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137280 00000100:00100000:1.0:1789175553.157188:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137280 00000100:00100000:1.0:1789175553.157250:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137152 00000100:00100000:1.0:1789175553.157254:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137152 00000100:00100000:1.0:1789175553.157282:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1789175553.157290:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251137280:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175553.157364:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251137280:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.157372:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1789175553.157388:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:1.0:1789175553.157395:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251137152:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175553.157437:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251137152:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.157444:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00080000:3.0:1789175553.157653:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789175553.157658:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175553.159072:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137024 00000100:00100000:0.0:1789175553.159088:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137024 00000100:00100000:0.0:1789175553.159246:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 292 00000100:00100000:0.0:1789175553.159259:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251137024:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175553.159387:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251137024:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 132us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175553.159396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 292 00010000:00010000:0.0:1789175553.505559:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175553.636504:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175553.636518:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175553.636764:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789175553.636882:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175553.637060:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274201856:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175553.639422:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baad840 going to sleep for 11 seconds 00000100:00100000:2.0:1789175553.656294:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175553.656378:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137536 00000100:00100000:2.0:1789175553.656393:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137536 00000100:00100000:2.0:1789175553.656495:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:2.0:1789175553.656519:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251137536:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175553.656577:0:8054:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175553.657272:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251137536:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 750us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175553.657283:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:3.0:1789175553.657703:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274201856:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789175553.669769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175553.669812:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137664 00000100:00100000:2.0:1789175553.669822:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137664 00000100:00100000:2.0:1789175553.669875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:2.0:1789175553.669885:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11519:x1876086251137664:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789175553.669979:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.669997:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670010:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670026:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670035:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670042:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670088:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670104:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670111:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175553.670559:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789175553.670564:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175553.670580:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670593:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670600:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670608:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670614:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175553.670618:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670627:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670640:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:2.0:1789175553.670643:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175553.670647:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670664:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c171ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670677:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670683:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670689:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670694:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175553.670698:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670705:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670712:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97e7181cd300) 00010000:00010000:2.0:1789175553.670715:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175553.670717:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670723:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17206 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670738:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670744:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670756:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670761:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175553.670764:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670771:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670778:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:2.0:1789175553.670781:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175553.670784:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.670790:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1720d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.670869:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11519:x1876086251137664:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 982us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175553.670878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:2.0:1789175553.675030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.675229:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251137920 00000100:00100000:1.0:1789175553.675239:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251137920 00000100:00100000:1.0:1789175553.675293:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:1.0:1789175553.675304:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11519:x1876086251137920:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175553.675479:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175553.675502:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17214 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e2a expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675601:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675613:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675622:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175553.675630:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789175553.675705:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675715:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675720:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675724:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175553.675727:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675732:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675740:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:1.0:1789175553.675742:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175553.675745:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675749:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c1721b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675779:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17214 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e2a expref: 38 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675786:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:1.0:1789175553.675788:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789175553.675790:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17214 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e2a expref: 38 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.675796:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175553.675866:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251137920:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 564us (844us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1789175553.675874:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:2.0:1789175553.678919:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.679012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251138048 00000100:00100000:3.0:1789175553.679022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251138048 00000100:00100000:3.0:1789175553.679277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:3.0:1789175553.679290:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251138048:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789175553.679364:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789175553.679489:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251138048:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 201us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175553.679497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:2.0:1789175553.683025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.683207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251138304 00000100:00100000:3.0:1789175553.683218:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251138304 00000100:00100000:3.0:1789175553.683272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:3.0:1789175553.683292:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251138304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175553.683322:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175553.683326:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789175553.683650:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c171d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e1c expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.683667:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:3.0:1789175553.683671:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175553.683683:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c17229 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e31 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789175553.684324:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789175553.685842:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c17230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.685856:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c17230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.685865:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c17230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.685916:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8a00/0x1112cdeac4c17229 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e31 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.685927:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c17230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e31 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.685933:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e7051dbf00) 00010000:00010000:3.0:1789175553.685935:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789175553.685943:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8200, rc 0) 00000100:00100000:3.0:1789175553.686007:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11519:x1876086251138304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 2716us (2992us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789175553.686016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:3.0:1789175553.692462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.693095:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251138560 00000100:00100000:0.0:1789175553.693105:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251138560 00000100:00100000:0.0:1789175553.693164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:0.0:1789175553.693174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11519:x1876086251138560:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.693240:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175553.693267:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8200/0x1112cdeac4c17230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e31 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693284:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e7051dbf00) 00010000:00010000:0.0:1789175553.693293:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175553.693314:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693327:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693336:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693376:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693382:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693397:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693587:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693594:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693798:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693804:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175553.693809:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693818:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693829:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175553.693832:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175553.693836:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693843:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1723e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693854:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693859:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693871:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693875:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175553.693878:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693883:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693890:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x161cf483 (ffff97e7102ec300) 00010000:00010000:0.0:1789175553.693893:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175553.693895:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.693901:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c17245 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x161cf483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.694788:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251138560:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1609us (2328us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175553.694800:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:2.0:1789175553.699571:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.702320:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251138688 00000100:00100000:1.0:1789175553.702626:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251138688 00000100:00100000:1.0:1789175553.702700:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 177 00000100:00100000:1.0:1789175553.702711:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11519:x1876086251138688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175553.702733:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175553.702757:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1724c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e38 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702797:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702813:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702826:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702922:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c1724c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 39 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702938:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 38 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.702947:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:1.0:1789175553.702950:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789175553.702960:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ba00, rc 0) 00000100:00100000:1.0:1789175553.703025:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11519:x1876086251138688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 316us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.703034:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 177 00000100:00100000:2.0:1789175553.706668:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.707121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251138944 00000100:00100000:0.0:1789175553.707131:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251138944 00000100:00100000:0.0:1789175553.707203:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 178 00000100:00100000:0.0:1789175553.707215:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11519:x1876086251138944:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.707302:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.707321:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.707361:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175553.707662:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1789175553.707671:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338666329043ns, next at 339666326922ns, rc = 0 00000004:00010000:0.0:1789175553.707735:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4ba2332 reply state 0000000095510b94 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.707742:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175553.707830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+40:11519:x1876086251138944:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 617us (1172us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789175553.707837:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 178 00010000:00010000:3.0:1789175553.712690:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712709:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712717:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712722:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175553.712727:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712735:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712752:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:3.0:1789175553.712755:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789175553.712759:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.712765:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1725a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.717963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.718088:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139072 00000100:00100000:0.0:1789175553.718099:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139072 00000100:00100000:0.0:1789175553.718171:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:0.0:1789175553.718182:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+39:11519:x1876086251139072:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.718218:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175553.718240:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e3f expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.718301:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 40 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.718327:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 40 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.718544:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:0.0:1789175553.718559:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175553.718564:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668e00, rc 0) 00000100:00100000:0.0:1789175553.718699:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+40:11519:x1876086251139072:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 518us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175553.718706:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:2.0:1789175553.733980:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.734044:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139200 00000100:00100000:1.0:1789175553.734053:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139200 00000100:00100000:1.0:1789175553.734130:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1789175553.734141:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251139200:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789175553.734817:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251139200:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 675us (844us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789175553.734825:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1789175553.739211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.739513:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139456 00000100:00100000:0.0:1789175553.739523:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139456 00000100:00100000:0.0:1789175553.739584:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1789175553.739595:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+40:11519:x1876086251139456:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789175553.739840:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+41:11519:x1876086251139456:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 245us (649us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789175553.739848:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1789175553.745592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.745637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139712 00000100:00100000:0.0:1789175553.745647:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139712 00000100:00100000:0.0:1789175553.745717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:0.0:1789175553.745730:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+41:11519:x1876086251139712:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789175553.745860:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+41:11519:x1876086251139712:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175553.745868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:3.0:1789175553.750673:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175553.751250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139840 00000100:00100000:2.0:1789175553.751261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139840 00000100:00100000:2.0:1789175553.751364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:2.0:1789175553.751375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+41:11519:x1876086251139840:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175553.751398:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175553.751419:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e46 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751499:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751516:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751529:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175553.751567:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175553.751586:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751611:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e46 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751626:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e46 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.751634:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:2.0:1789175553.751637:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789175553.751641:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5000, rc 0) 00000100:00100000:2.0:1789175553.751707:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+42:11519:x1876086251139840:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 334us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175553.751722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:2.0:1789175553.755284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.755418:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251139968 00000100:00100000:1.0:1789175553.755427:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251139968 00000100:00100000:1.0:1789175553.755488:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:1.0:1789175553.755500:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251139968:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175553.755518:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175553.755536:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e4d expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789175553.755558:0:12165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a702, blocks: 0x1 00010000:00010000:1.0:1789175553.755573:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789175553.755576:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175553.755583:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 8 pid: 12165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.755606:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 8 pid: 12165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.755616:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a200, rc 0) 00000100:00100000:1.0:1789175553.755665:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251139968:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.755672:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:3.0:1789175553.758900:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.758949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140224 00000100:00100000:0.0:1789175553.758959:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140224 00000100:00100000:0.0:1789175553.759026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 182 00000100:00100000:0.0:1789175553.759038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+42:11519:x1876086251140224:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789175553.759160:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+42:11519:x1876086251140224:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175553.759176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 182 00000100:00100000:2.0:1789175553.768082:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.768229:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140352 00000100:00100000:1.0:1789175553.768241:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140352 00000100:00100000:1.0:1789175553.768304:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1789175553.768326:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:11519:x1876086251140352:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175553.768361:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175553.768546:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e54 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.768579:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 9 pid: 12165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.768588:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175553.768592:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175553.768598:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.768634:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 9 pid: 12165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.768658:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 9 pid: 12165 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.768674:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274201984:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175553.768772:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175553.783955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.784023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140480 00000100:00100000:3.0:1789175553.784033:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140480 00010000:00010000:3.0:1789175553.784076:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 10 pid: 12165 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.784133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1789175553.784143:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2353:x1876086251140480:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175553.784158:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175553.784180:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 10 pid: 12165 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.784205:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 10 pid: 12165 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.784231:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175553.784236:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175553.784245:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.784256:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.784297:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.784335:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1876086274202112:192.168.201.18@tcp:105: 00000100:00100000:3.0:1789175553.784645:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141e780 going to sleep for 11 seconds 00010000:00010000:1.0:1789175553.785786:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e881493e/0x1112cdeac4c17276 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e4d expref: 10 pid: 12165 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.785806:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274201984:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175553.785836:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.785850:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175553.785911:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:11519:x1876086251140352:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 17587us (17839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.785921:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000040:00080000:0.0:1789175553.788770:0:12403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789175553.788780:0:12403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175553.788826:0:12403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789175553.788832:0:12403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175553.806722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.806870:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1876086274202112:192.168.201.18@tcp:105: 00010000:00010000:3.0:1789175553.806897:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175553.806949:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251140480:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 22806us (23004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175553.806960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1789175553.807000:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140608 00000100:00100000:3.0:1789175553.807007:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140608 00002000:00100000:3.0:1789175553.807064:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97e726705f80 x1876086251140608/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:724/0 lens 504/0 e 0 to 0 dl 1789175564 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175553.807075:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e726705f80 with x1876086251140608 ext(0->8) 00002000:00010000:3.0:1789175553.807081:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e726705f80 00000100:00100000:3.0:1789175553.807105:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1789175553.807116:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251140608:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789175553.807567:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2354:x1876086251140608:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 451us (853us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789175553.807575:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00002000:00100000:3.0:1789175553.807581:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97e726705f80 x1876086251140608/t4294967314(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:724/0 lens 504/448 e 0 to 0 dl 1789175564 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175553.807590:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e726705f80 with x1876086251140608 ext(0->8) 00002000:00010000:3.0:1789175553.807593:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e726705f80 00000100:00100000:2.0:1789175553.814575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.814659:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140736 00000100:00100000:1.0:1789175553.814670:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140736 00000100:00100000:1.0:1789175553.814733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 183 00000100:00100000:1.0:1789175553.814744:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+42:11519:x1876086251140736:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789175553.872591:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1789175553.872611:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789175553.872644:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1789175553.872879:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11519:x1876086251140736:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 58131us (58305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175553.872891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 183 00000100:00100000:3.0:1789175553.872994:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274202240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789175553.873050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789175553.873508:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789175553.873521:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789175553.873524:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274202240 00000100:00100000:1.0:1789175553.873533:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274202240 00000100:00100000:2.0:1789175553.873713:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789175553.873723:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274202240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789175553.873890:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789175553.873893:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789175554 00002000:00010000:2.0:1789175553.873896:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789175553.873899:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789175554 -> 1789175554 00002000:00010000:2.0:1789175553.873901:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789175553.873947:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274202240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (895us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789175553.873955:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789175553.874001:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789175553.874905:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e734438380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789175553.874914:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274202240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789175553.876635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175553.877108:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251140864 00000100:00100000:1.0:1789175553.877119:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251140864 00000100:00100000:1.0:1789175553.877262:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1789175553.877272:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2354:x1876086251140864:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789175553.911560:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2354:x1876086251140864:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 34277us (34921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175553.911933:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000001:00080000:3.0:1789175553.911976:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789175553.911989:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1789175553.911996:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1789175553.914523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.914565:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141120 00000100:00100000:0.0:1789175553.914577:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141120 00000100:00100000:0.0:1789175553.914642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 184 00000100:00100000:0.0:1789175553.914652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11519:x1876086251141120:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.914705:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175553.914733:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c1726f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e46 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.914750:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:0.0:1789175553.914756:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175553.914792:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.914807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.914817:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175553.915124:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d8cef4b reply state 000000002a151737 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.915141:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175553.915262:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11519:x1876086251141120:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 610us (745us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789175553.915270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 184 00010000:00010000:1.0:1789175553.923097:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923118:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923125:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923133:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175553.923137:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923147:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923165:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:1.0:1789175553.923169:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175553.923174:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.923181:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17284 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.924161:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.924332:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141248 00000100:00100000:0.0:1789175553.924357:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141248 00000100:00100000:0.0:1789175553.924420:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1789175553.924431:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251141248:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789175553.924681:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789175553.924685:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789175554 -> 1789175552 00002000:00010000:0.0:1789175553.924687:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789175551 00002000:00010000:0.0:1789175553.924690:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789175554 -> 1789175552 00002000:00010000:0.0:1789175553.924692:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789175553.924748:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251141248:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 319us (594us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789175553.924757:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1789175553.926994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.927097:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141504 00000100:00100000:0.0:1789175553.927108:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141504 00000100:00100000:0.0:1789175553.927197:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:0.0:1789175553.927208:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11519:x1876086251141504:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.927283:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.927313:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.927333:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.927388:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.927401:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 18 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.927415:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274202368:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175553.927503:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e726858180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175553.929930:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.930018:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274202368:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175553.930060:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.930661:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141632 00000100:00100000:1.0:1789175553.930668:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141632 00010000:00010000:1.0:1789175553.930704:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.930750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1789175553.930759:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707444450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2353:x1876086251141632:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175553.930774:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175553.930781:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930793:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930815:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e38 expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930829:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:1.0:1789175553.930834:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930844:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930852:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.930884:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175553.930938:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707444450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+18:2353:x1876086251141632:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 179us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.930944:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00010000:00010000:0.0:1789175553.931282:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931290:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931334:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931360:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931375:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931381:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175553.931385:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931393:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931403:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:0.0:1789175553.931406:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789175553.931410:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.931415:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c1728b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.931460:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+17:11519:x1876086251141504:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 4255us (4476us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789175553.931469:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:3.0:1789175553.942614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.942708:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141760 00000100:00100000:0.0:1789175553.942720:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141760 00000100:00100000:0.0:1789175553.942812:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1789175553.942826:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251141760:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.942879:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.942902:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.942917:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175553.942922:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175553.942927:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.942967:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.942982:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 8 pid: 6686 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.942999:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274202496:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175553.943083:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e726858180 going to sleep for 11 seconds 00000100:00100000:3.0:1789175553.950508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.950717:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6686:1876086274202496:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175553.950751:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.950986:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251141888 00000100:00100000:1.0:1789175553.950999:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251141888 00010000:00010000:1.0:1789175553.951037:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.951080:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1789175553.951091:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251141888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175553.951108:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175553.951216:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.951230:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.951256:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d5ceac/0x1112cdeac4c1727d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e54 expref: 9 pid: 6686 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.951271:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175553.951275:0:8505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789175553.951282:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.951292:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.951629:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175553.951682:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251141888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 593us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175553.951699:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00010000:00010000:0.0:1789175553.952718:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952735:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952766:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952775:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952798:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952805:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175553.952809:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952819:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952836:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.952845:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c17292 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.952966:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251141760:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 10139us (10359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175553.952976:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1789175553.954795:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175553.955296:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251142144 00000100:00100000:0.0:1789175553.955306:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251142144 00000100:00100000:0.0:1789175553.955481:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00100000:0.0:1789175553.955492:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+17:11519:x1876086251142144:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789175553.955576:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955601:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955837:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955850:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955859:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955895:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175553.955908:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 18 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175553.955921:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274202624:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175553.956015:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e726858300 going to sleep for 11 seconds 00000100:00100000:0.0:1789175553.963606:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274202624:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175553.963638:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175553.963856:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175553.963964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251142272 00000100:00100000:2.0:1789175553.963973:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251142272 00010000:00010000:2.0:1789175553.964009:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.964046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:2.0:1789175553.964069:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2353:x1876086251142272:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175553.964084:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175553.964091:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964103:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964140:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e3f expref: 19 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964153:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:2.0:1789175553.964158:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964168:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964174:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.964204:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175553.964261:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+18:2353:x1876086251142272:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 194us (406us total) trans 0 rc 0/0 00010000:00010000:0.0:1789175553.964266:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.964269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00010000:00010000:0.0:1789175553.964279:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175553.964589:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789175553.964691:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789175553.964720:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789175553.964781:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274202752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789175553.964830:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175553.964865:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7147d0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175553.964870:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274202752 00000100:00100000:2.0:1789175553.964875:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274202752 00000100:00100000:2.0:1789175553.964951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789175553.964959:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274202752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789175553.965041:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274202752:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175553.965048:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789175553.965078:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789175553.965084:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e734438380, transno 4294967315 00000100:00100000:3.0:1789175553.965135:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274202752:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789175553.965910:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789175553.965979:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274202880:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789175553.966021:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175553.966056:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175553.966236:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274202880 00000100:00100000:2.0:1789175553.966245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274202880 00000100:00100000:2.0:1789175553.966277:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175553.966284:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274202880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789175553.966962:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876086274202880:12345-0@lo:1000:mdt00_002.0 Request processed in 675us (937us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789175553.966970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789175553.967271:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274202880:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789175553.967323:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967333:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967358:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967432:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175553.967439:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967448:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967464:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e721b55e00) 00010000:00010000:3.0:1789175553.967468:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175553.967473:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967480:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c172a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967515:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967523:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967529:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967544:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175553.967548:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967554:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967562:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:3.0:1789175553.967564:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789175553.967567:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.967572:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c171dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.967630:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.967645:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 21 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.967654:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.967685:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 21 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.967697:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 21 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.967706:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274203008:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175553.967770:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175553.971103:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175553.971160:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251142400 00000100:00100000:3.0:1789175553.971171:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251142400 00010000:00010000:3.0:1789175553.971221:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 22 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.971247:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e733d05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274203008:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175553.971284:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.971293:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1789175553.971303:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+22:2354:x1876086251142400:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175553.971329:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175553.971335:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 22 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971370:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 22 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971407:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c171f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e23 expref: 22 pid: 8054 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971421:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:3.0:1789175553.971426:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971436:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971443:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175553.971472:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175553.971488:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971495:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971507:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971513:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971520:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.971524:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2354:x1876086251142400:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 222us (430us total) trans 0 rc 0/0 00010000:00010000:2.0:1789175553.971526:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175553.971530:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175553.971531:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00010000:00010000:2.0:1789175553.971538:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971547:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:2.0:1789175553.971549:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175553.971678:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971685:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c172a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971704:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971710:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971717:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971722:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175553.971726:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971732:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971741:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd200) 00010000:00010000:2.0:1789175553.971743:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175553.971746:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.971753:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175553.972416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11519:x1876086251142144:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 16923us (17624us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789175553.972427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 186 00000020:00080000:2.0:1789175553.972431:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789175553.972789:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175553.972794:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175553.974252:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789175553.974268:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789175553.974450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175553.974492:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251142656 00000100:00100000:2.0:1789175553.974500:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251142656 00000100:00100000:2.0:1789175553.974569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:2.0:1789175553.974579:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11519:x1876086251142656:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789175553.975133:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789175553.975261:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1789175553.975298:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975318:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975331:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975364:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975505:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975510:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175553.975523:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789175553.975610:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11519:x1876086251142656:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1031us (1288us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789175553.975618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000020:00080000:2.0:1789175553.975624:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789175553.975723:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175553.975730:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.975737:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175553.975741:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.975750:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.975765:0:6702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97e7181cdb00) 00010000:00010000:1.0:1789175553.975768:0:6702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789175553.975774:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.975781:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c172ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175553.975801:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175553.975802:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175553.975804:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175554.529741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175555.553972:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789175555.816118:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789175555.816133:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789175555.816220:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789175555.816227:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175556.007252:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274203136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175556.007587:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175556.007698:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203136 00000100:00100000:0.0:1789175556.007707:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203136 00000100:00100000:0.0:1789175556.007769:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789175556.007780:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274203136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175556.007818:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175556.007869:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274203136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.007875:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789175556.008165:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175556.008500:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274203136:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789175556.008734:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789175556.008739:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789175556.008960:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789175556.008966:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789175556.101327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.107082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251142912 00000100:00100000:1.0:1789175556.107099:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251142912 00000100:00100000:1.0:1789175556.107321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 187 00000100:00100000:1.0:1789175556.107333:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+22:11539:x1876086251142912:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175556.107384:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175556.107410:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c172b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e5b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.107512:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c172bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.107528:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c172bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.107542:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c172bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175556.107552:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789175556.107669:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c172b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e5b expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.107687:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c172bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e5b expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.107697:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175556.107714:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789175556.107718:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a200, rc 0) 00000100:00100000:1.0:1789175556.107784:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11539:x1876086251142912:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 454us (6468us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789175556.107792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 187 00000100:00080000:1.0:1789175556.107815:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175556.119501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.119541:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251143040 00000100:00100000:2.0:1789175556.119553:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251143040 00000100:00100000:2.0:1789175556.119609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 188 00000100:00100000:2.0:1789175556.119620:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11539:x1876086251143040:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1789175556.119704:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.119724:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.119737:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.119753:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.119760:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.119767:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120022:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120031:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120038:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175556.120092:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120105:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120112:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120120:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120126:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.120130:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120137:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120160:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175556.120163:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.120168:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120891:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120913:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120919:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120935:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120941:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.120944:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120950:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120959:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd300) 00010000:00010000:2.0:1789175556.120962:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.120965:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120971:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120986:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120991:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.120997:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.121002:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.121004:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.121021:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.121028:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd700) 00010000:00010000:2.0:1789175556.121031:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.121034:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.121039:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175556.121160:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11539:x1876086251143040:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 1528us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175556.121172:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 188 00000100:00100000:1.0:1789175556.187327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.187584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251143296 00000100:00100000:2.0:1789175556.187594:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251143296 00000100:00100000:2.0:1789175556.187656:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:2.0:1789175556.187667:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+24:11542:x1876086251143296:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175556.187688:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175556.187710:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e62 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187780:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187794:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187807:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187836:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187843:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.187850:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188129:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188156:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175556.188166:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789175556.188271:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188280:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188286:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188291:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.188296:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188314:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188326:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175556.188329:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.188334:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188379:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c172e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188391:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188397:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188403:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188408:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.188412:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188417:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188423:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd700) 00010000:00010000:2.0:1789175556.188426:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.188428:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188443:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c172ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188485:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c172df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188498:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.188505:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175556.188507:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175556.188509:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5600, rc 0) 00000100:00100000:2.0:1789175556.188578:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11542:x1876086251143296:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 912us (1260us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789175556.188586:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:2.0:1789175556.194367:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175556.194743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251143424 00000100:00100000:3.0:1789175556.194754:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251143424 00000100:00100000:3.0:1789175556.194809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:3.0:1789175556.194819:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11542:x1876086251143424:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175556.194886:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194914:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194926:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194953:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194963:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194969:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194974:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175556.194978:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194985:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.194994:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:3.0:1789175556.194996:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175556.195001:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.195006:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c17302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175556.195085:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11542:x1876086251143424:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 267us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.195101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:3.0:1789175556.200170:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.200283:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251143680 00000100:00100000:1.0:1789175556.200294:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251143680 00000100:00100000:1.0:1789175556.200391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1789175556.200403:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11542:x1876086251143680:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1789175556.200656:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+27:11542:x1876086251143680:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 254us (497us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789175556.200664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1789175556.287620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.287888:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251143936 00000100:00100000:2.0:1789175556.287900:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251143936 00000100:00100000:2.0:1789175556.287971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:2.0:1789175556.287983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+27:11067:x1876086251143936:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175556.288009:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175556.288034:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17309 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e69 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.288158:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.288606:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.288616:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.288689:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.288705:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 28 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175556.288720:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274203264:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175556.289055:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175556.302636:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274203264:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175556.302669:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175556.303821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175556.304305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144064 00000100:00100000:3.0:1789175556.304316:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144064 00010000:00010000:3.0:1789175556.304396:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 29 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175556.304444:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:3.0:1789175556.304454:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+29:2353:x1876086251144064:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175556.304469:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175556.304477:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 29 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304490:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 29 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304512:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c172f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e62 expref: 29 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304527:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:3.0:1789175556.304531:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304540:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304547:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.304590:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175556.304651:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+28:2353:x1876086251144064:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 199us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.304658:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00010000:00010000:1.0:1789175556.304976:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.304984:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175556.305002:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789175556.305173:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17309 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.305199:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.305206:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:1.0:1789175556.305209:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789175556.305212:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4e00, rc 0) 00000100:00100000:1.0:1789175556.305255:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+28:11067:x1876086251143936:12345-192.168.201.18@tcp:101:bash.0 Request processed in 17275us (17647us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789175556.305263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:1.0:1789175556.313803:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175556.313874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144320 00000100:00100000:3.0:1789175556.313884:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144320 00000100:00100000:3.0:1789175556.313946:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:3.0:1789175556.313957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+28:11067:x1876086251144320:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1789175556.314260:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.314289:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.314303:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789175556.314401:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1789175556.314428:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e0d49bc reply state 000000005378dc86 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175556.314437:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789175556.314490:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1789175556.314605:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11067:x1876086251144320:12345-192.168.201.18@tcp:36:bash.0 Request processed in 649us (811us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789175556.314613:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 192 00000020:00080000:3.0:1789175556.314617:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789175556.316746:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316762:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316770:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316791:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.316796:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316804:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316821:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175556.316824:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175556.316830:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.316836:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9000/0x1112cdeac4c1731e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175556.320424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.321805:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144448 00000100:00100000:0.0:1789175556.321818:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144448 00000100:00100000:0.0:1789175556.321876:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:0.0:1789175556.321887:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11067:x1876086251144448:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175556.321914:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175556.321936:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17325 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e70 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.321997:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17325 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e70 expref: 32 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.322014:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17325 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e70 expref: 32 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.322055:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175556.322058:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175556.322062:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668000, rc 0) 00000100:00100000:0.0:1789175556.322133:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11067:x1876086251144448:12345-192.168.201.18@tcp:101:bash.0 Request processed in 247us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.322140:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:3.0:1789175556.325037:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.325243:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144576 00000100:00100000:1.0:1789175556.325254:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144576 00000100:00100000:1.0:1789175556.325383:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1789175556.325394:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:11067:x1876086251144576:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1789175556.325410:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175556.325432:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e77 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789175556.325460:0:12165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4a700, atime: 0x6aa4a6ff, ctime: 0x6aa4a700, blocks: 0xb 00010000:00010000:1.0:1789175556.325484:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789175556.325489:0:12165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175556.325497:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 8 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.325537:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 8 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.325550:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175556.325604:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:11067:x1876086251144576:12345-192.168.201.18@tcp:101:bash.0 Request processed in 211us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175556.325610:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00080000:2.0:1789175556.326395:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175556.332300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.332482:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144704 00000100:00100000:2.0:1789175556.332492:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144704 00002000:00010000:2.0:1789175556.332533:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789175556.332538:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e73467ca80 with x1876086251144704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789175556.332551:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e73467ca80. 00000100:00100000:2.0:1789175556.332588:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1789175556.332599:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251144704:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:2.0:1789175556.332887:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789175556.332891:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789175552 -> 1789175556 00002000:00010000:2.0:1789175556.332894:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789175551 -> 1789175551 00002000:00010000:2.0:1789175556.332896:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789175552 -> 1789175556 00002000:00010000:2.0:1789175556.332905:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789175556.332982:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251144704:12345-192.168.201.18@tcp:10:bash.0 Request processed in 384us (691us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789175556.332991:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00002000:00010000:2.0:1789175556.332995:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789175556.332998:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e73467ca80 with x1876086251144704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789175556.333003:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e73467ca80. 00000100:00100000:3.0:1789175556.471723:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.471832:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251144832 00000100:00100000:2.0:1789175556.471842:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251144832 00000100:00100000:2.0:1789175556.471909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:2.0:1789175556.471919:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11556:x1876086251144832:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1789175556.471998:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472016:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472028:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472059:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472067:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472073:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472392:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472409:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472417:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175556.472462:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472474:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472482:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472489:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472495:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.472499:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472507:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472517:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175556.472520:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.472525:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472531:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472549:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472554:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472560:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472564:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.472567:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472572:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472578:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7181cd700) 00010000:00010000:2.0:1789175556.472581:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.472584:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472588:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c1733a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472601:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472606:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472611:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472622:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.472625:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472631:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472638:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175556.472640:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.472643:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.472647:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5200/0x1112cdeac4c17341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175556.472724:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11556:x1876086251144832:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 805us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175556.472732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:0.0:1789175556.513700:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274203392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175556.513791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175556.513924:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203392 00000100:00100000:3.0:1789175556.513934:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203392 00000100:00100000:3.0:1789175556.514002:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789175556.514012:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7347d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274203392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175556.514073:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175556.514125:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7347d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274203392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.514132:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789175556.514628:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175556.514658:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1789175556.514664:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1789175556.514683:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e73c011180, transno 4294967307 00000100:00100000:0.0:1789175556.514713:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274203392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175556.515329:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274203648:0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175556.515435:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789175556.515441:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274203520:0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515470:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175556.515500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274204032:0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175556.515552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203648 00000100:00100000:1.0:1789175556.515557:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203648 00000100:00100000:1.0:1789175556.515589:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274204032 00000100:00100000:1.0:1789175556.515592:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274204032 00000100:00100000:1.0:1789175556.515618:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789175556.515626:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274203648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274203648:12345-0@lo:400:kworker.0 Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175556.515677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789175556.515693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789175556.515715:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274204032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515744:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274204032:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175556.515749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789175556.515777:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274204032:0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.515786:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274203648:0@lo:400:kworker.0 00000100:00080000:0.0:1789175556.515871:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175556.515883:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274203904:0@lo:400:kworker.0 00000100:00100000:0.0:1789175556.515911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175556.515942:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175556.515947:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274203776:0@lo:400:kworker.0 00000100:00100000:0.0:1789175556.515967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175556.515988:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203776 00000100:00100000:0.0:1789175556.515991:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203776 00000100:00100000:0.0:1789175556.516017:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789175556.516023:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274203776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175556.516064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274203776:12345-0@lo:400:kworker.0 Request processed in 40us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.516083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789175556.516100:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175556.516117:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274203776:0@lo:400:kworker.0 00000100:00100000:3.0:1789175556.516304:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203520 00000100:00100000:3.0:1789175556.516310:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203520 00000100:00100000:3.0:1789175556.516371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789175556.516380:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274203520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175556.516420:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274203520:12345-0@lo:400:kworker.0 Request processed in 43us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.516426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789175556.516461:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274203520:0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.516711:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274203904 00000100:00100000:1.0:1789175556.516716:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274203904 00000100:00100000:1.0:1789175556.516754:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789175556.516762:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274203904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175556.516798:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274203904:12345-0@lo:400:kworker.0 Request processed in 38us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175556.516804:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789175556.519904:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274203904:0@lo:400:kworker.0 00000100:00100000:0.0:1789175556.559337:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.559680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145088 00000100:00100000:1.0:1789175556.559692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145088 00000100:00100000:1.0:1789175556.559759:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:1.0:1789175556.559772:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+32:11559:x1876086251145088:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175556.559793:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175556.559817:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e7e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559901:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559917:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559952:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559970:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559978:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.559985:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560310:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c1735d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560321:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c1735d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560374:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c1735d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175556.560385:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789175556.560708:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560717:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560724:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560731:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654bc00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175556.560743:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560751:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560764:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175556.560767:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175556.560772:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560779:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654bc00/0x1112cdeac4c1734f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560791:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560797:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560803:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560808:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175556.560811:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560817:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560825:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e721b55d00) 00010000:00010000:1.0:1789175556.560828:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175556.560838:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560844:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654ba00/0x1112cdeac4c17356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560893:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b200/0x1112cdeac4c17348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e7e expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560908:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c1735d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e7e expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.560916:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:1.0:1789175556.560919:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789175556.560921:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031e00, rc 0) 00000100:00100000:1.0:1789175556.560998:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11559:x1876086251145088:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1228us (1686us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789175556.561006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:3.0:1789175556.570582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.572893:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145216 00000100:00100000:0.0:1789175556.572910:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145216 00000100:00100000:0.0:1789175556.573038:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:0.0:1789175556.573051:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11559:x1876086251145216:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1789175556.573226:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.573246:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.573256:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.573295:0:8054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.573309:0:8054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 34 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.573560:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274204160:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175556.573701:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546d80 going to sleep for 11 seconds 00010000:00010000:0.0:1789175556.577660:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175556.578974:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.579119:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8054:1876086274204160:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175556.579159:0:8054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175556.581641:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145472 00000100:00100000:2.0:1789175556.581656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145472 00000100:00100000:2.0:1789175556.581738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1789175556.581749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+35:5593:x1876086251145472:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789175556.582153:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:5593:x1876086251145472:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 403us (3184us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789175556.582232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:3.0:1789175556.589133:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.589496:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145600 00000100:00100000:0.0:1789175556.589506:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145600 00010000:00010000:0.0:1789175556.589547:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 36 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.589589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:0.0:1789175556.589599:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:2354:x1876086251145600:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175556.589614:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175556.589621:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 36 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589634:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 36 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589655:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17310 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e69 expref: 36 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589673:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175556.589679:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589689:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589712:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.589751:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175556.589809:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+35:2354:x1876086251145600:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 211us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.589816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00010000:00010000:1.0:1789175556.589887:0:8054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589896:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589927:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589934:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589941:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589954:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175556.589958:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589966:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589975:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:1.0:1789175556.589977:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789175556.589981:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.589987:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1736b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175556.590025:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11559:x1876086251145216:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 16977us (19451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175556.590032:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:3.0:1789175556.600903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.601024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145856 00000100:00100000:1.0:1789175556.601035:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145856 00000100:00100000:1.0:1789175556.601113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1789175556.601123:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+34:11559:x1876086251145856:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1789175556.601448:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11559:x1876086251145856:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 325us (557us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789175556.601456:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:2.0:1789175556.740439:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175556.740491:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175556.740631:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251146112 00000100:00100000:1.0:1789175556.740642:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251146112 00000100:00100000:1.0:1789175556.740711:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1789175556.740736:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251146112:12345-192.168.201.18@tcp:16:kworker.0 00000100:00100000:3.0:1789175556.740975:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251145984 00000100:00100000:3.0:1789175556.740980:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251145984 00002000:00100000:3.0:1789175556.741011:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff97e72643f100 x1876086251145984/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:727/0 lens 496/0 e 0 to 0 dl 1789175567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175556.741022:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72643f100 with x1876086251145984 ext(0->7) 00002000:00010000:3.0:1789175556.741028:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72643f100 00000100:00100000:3.0:1789175556.741064:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175556.741072:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2354:x1876086251145984:12345-192.168.201.18@tcp:4:bash.0 00000100:00100000:3.0:1789175556.741603:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+12:2354:x1876086251145984:12345-192.168.201.18@tcp:4:bash.0 Request processed in 530us (1173us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789175556.741613:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00002000:00100000:3.0:1789175556.741622:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->7) req@ffff97e72643f100 x1876086251145984/t4294967319(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:727/0 lens 496/448 e 0 to 0 dl 1789175567 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175556.741631:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72643f100 with x1876086251145984 ext(0->7) 00002000:00010000:3.0:1789175556.741635:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72643f100 00000100:00100000:3.0:1789175556.767289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.767422:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251146368 00000100:00100000:0.0:1789175556.767434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251146368 00000100:00100000:0.0:1789175556.767502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:0.0:1789175556.767513:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+35:11570:x1876086251146368:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:0.0:1789175556.767541:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175556.767564:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e85 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767637:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767653:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767665:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767681:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767689:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767715:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767968:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767978:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.767987:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175556.767996:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789175556.768086:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768094:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768101:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768108:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.768113:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768121:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768132:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175556.768148:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175556.768159:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c17379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768181:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768186:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768191:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768195:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.768198:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768203:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768211:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ec500) 00010000:00010000:0.0:1789175556.768214:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175556.768217:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768223:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768267:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e85 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768307:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e85 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.768316:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175556.768319:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175556.768322:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:0.0:1789175556.768436:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11570:x1876086251146368:12345-192.168.201.18@tcp:101:cat.0 Request processed in 924us (1157us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789175556.768444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:1.0:1789175556.776444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175556.777606:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251146624 00000100:00100000:3.0:1789175556.777619:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251146624 00000100:00100000:3.0:1789175556.777685:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1789175556.777697:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11570:x1876086251146624:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:3.0:1789175556.778452:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11570:x1876086251146624:12345-192.168.201.18@tcp:35:cat.0 Request processed in 754us (2012us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789175556.778461:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:2.0:1789175556.820328:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.820463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251146880 00000100:00100000:0.0:1789175556.820475:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251146880 00000100:00100000:0.0:1789175556.820539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 198 00000100:00100000:0.0:1789175556.820551:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11571:x1876086251146880:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1789175556.820605:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789175556.820633:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e85 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820654:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c1735d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e7e expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17325 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e70 expref: 36 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820677:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175556.820689:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175556.820717:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820733:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820743:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820766:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.820773:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821019:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821028:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821188:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175556.821796:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789175556.821806:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341780464158ns, next at 342780461852ns, rc = 0 00010000:00010000:0.0:1789175556.821883:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821894:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821908:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821917:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821924:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821930:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821955:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175556.821976:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.821984:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.821992:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175556.821992:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822004:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822004:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.822011:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822017:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175556.822022:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822024:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822039:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822051:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:0.0:1789175556.822055:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789175556.822067:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822076:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822077:0:6702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97e7102ec000) 00010000:00010000:1.0:1789175556.822085:0:6702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789175556.822100:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822102:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822114:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c173aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822117:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822142:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822149:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.822152:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822157:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175556.822159:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.822161:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175556.822165:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175556.822174:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175556.822177:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175556.822180:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.822187:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c17395 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175556.822198:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d897809 reply state 000000000504c6ef transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.822218:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175556.822308:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+37:11571:x1876086251146880:12345-192.168.201.18@tcp:36:rm.0 Request processed in 1756us (1986us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789175556.822316:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 198 00010000:00010000:1.0:1789175556.824903:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824922:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824930:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824951:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175556.824956:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824964:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824981:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ec500) 00010000:00010000:1.0:1789175556.824984:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175556.824990:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175556.824996:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c1739c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789175556.826601:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789175556.826621:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1789175556.826626:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1789175556.826632:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:3.0:1789175556.826769:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251146112:12345-192.168.201.18@tcp:16:kworker.0 Request processed in 86030us (86270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.826780:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1789175556.905241:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.905380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147136 00000100:00100000:0.0:1789175556.905390:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147136 00000100:00100000:0.0:1789175556.905457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:0.0:1789175556.905468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+36:11577:x1876086251147136:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175556.905496:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175556.905519:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c173b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e8c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905643:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905658:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905670:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905688:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905695:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.905702:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175556.906626:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789175556.906796:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.906809:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.906818:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908489:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908500:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908508:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908513:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175556.908518:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908526:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908541:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175556.908544:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175556.908549:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c173b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175556.908571:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ea604e3 reply state 00000000b3e520c8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175556.908581:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789175556.908619:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c173b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908634:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175556.908654:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:2.0:1789175556.908657:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175556.908660:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:2.0:1789175556.908752:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+39:11577:x1876086251147136:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3284us (3525us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789175556.908761:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00010000:00010000:0.0:1789175556.911384:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911402:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911409:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911414:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175556.911419:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911427:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911445:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ec300) 00010000:00010000:0.0:1789175556.911449:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175556.911453:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.911480:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c173bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175556.919003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175556.919217:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147264 00000100:00100000:3.0:1789175556.919242:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147264 00000100:00100000:3.0:1789175556.919321:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1789175556.919332:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2354:x1876086251147264:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1789175556.919386:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175556.919407:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e93 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175556.919433:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175556.919453:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1789175556.919457:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175556.919466:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.919486:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175556.919499:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8a00, rc 0) 00000100:00100000:3.0:1789175556.919557:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251147264:12345-192.168.201.18@tcp:101:bash.0 Request processed in 227us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175556.919564:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00080000:0.0:1789175556.919637:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175556.925285:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.926168:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147392 00000100:00100000:0.0:1789175556.926179:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147392 00000100:00100000:0.0:1789175556.926262:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1789175556.926274:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+6:11577:x1876086251147392:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175556.926292:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175556.926311:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2e9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.926375:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.926385:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175556.926389:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175556.926395:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.926430:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.926444:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.926479:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274204288:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175556.926572:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175556.929589:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1876086274204288:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175556.929628:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.929650:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668000, rc 0) 00000100:00100000:0.0:1789175556.929713:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:11577:x1876086251147392:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3441us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.929723:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1789175556.930289:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.930384:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147520 00000100:00100000:0.0:1789175556.930392:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147520 00010000:00010000:0.0:1789175556.930421:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.930447:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1789175556.930455:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251147520:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175556.930468:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175556.930489:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.930501:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.930540:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003871164a/0x1112cdeac4c173d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e93 expref: 7 pid: 6687 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.930555:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175556.930559:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175556.930567:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.930576:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175556.930610:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175556.930623:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1876086274204416:192.168.201.18@tcp:105: 00000100:00100000:0.0:1789175556.933878:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175556.953183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175556.953482:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1876086274204416:192.168.201.18@tcp:105: 00010000:00010000:0.0:1789175556.953508:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175556.953560:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2353:x1876086251147520:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 23105us (23273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175556.953572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:2.0:1789175556.953800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147776 00000100:00100000:2.0:1789175556.953807:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147776 00000100:00100000:2.0:1789175556.953862:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1789175556.953871:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+38:11577:x1876086251147776:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1789175556.954224:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+39:11577:x1876086251147776:12345-192.168.201.18@tcp:35:bash.0 Request processed in 353us (1050us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789175556.954231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1789175557.193653:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.193772:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251147904 00000100:00100000:0.0:1789175557.193782:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251147904 00000100:00100000:0.0:1789175557.193856:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:0.0:1789175557.193876:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+39:11593:x1876086251147904:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175557.193901:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175557.193920:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c173e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ea1 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.193997:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.194014:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.194319:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175557.194388:0:8054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789175557.194393:0:8054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175557.194412:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.194438:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c173e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea1 expref: 41 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.194457:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea1 expref: 40 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.194465:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175557.194468:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175557.194471:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668a00, rc 0) 00000100:00100000:0.0:1789175557.194534:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+40:11593:x1876086251147904:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 660us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.194550:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:3.0:1789175557.199468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.199554:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148160 00000100:00100000:2.0:1789175557.199566:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148160 00000100:00100000:2.0:1789175557.199631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:2.0:1789175557.199642:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+40:11593:x1876086251148160:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175557.199665:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175557.199690:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c173f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ea8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.199798:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c173f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.199814:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c173f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.199845:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c173f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175557.199858:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789175557.200000:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4600/0x1112cdeac4c173f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea8 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.200018:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c173f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea8 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.200027:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:2.0:1789175557.200030:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175557.200034:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5a00, rc 0) 00000100:00100000:2.0:1789175557.200467:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+42:11593:x1876086251148160:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 825us (1007us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789175557.200475:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:3.0:1789175557.205786:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175557.205893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175557.206636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148544 00000100:00100000:1.0:1789175557.206649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148544 00000100:00100000:1.0:1789175557.206717:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1789175557.206730:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+42:2356:x1876086251148544:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175557.206750:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175557.206778:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c173f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea8 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.206800:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:1.0:1789175557.206806:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175557.206976:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707444c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+41:2356:x1876086251148544:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 247us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175557.206984:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1789175557.207111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148416 00000100:00100000:2.0:1789175557.207116:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148416 00000100:00100000:2.0:1789175557.207164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:2.0:1789175557.207173:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+41:11593:x1876086251148416:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175557.207194:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175557.207210:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2eaf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.207650:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.207676:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.207686:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175557.207699:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789175557.207825:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eaf expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.207840:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eaf expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.207848:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:2.0:1789175557.207851:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789175557.207854:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:2.0:1789175557.207890:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+43:11593:x1876086251148416:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 719us (2118us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789175557.207897:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:1.0:1789175557.220953:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175557.221496:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148672 00000100:00100000:3.0:1789175557.221526:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148672 00000100:00100000:3.0:1789175557.221598:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1789175557.221609:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+6:2354:x1876086251148672:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:3.0:1789175557.221658:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.221682:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.221691:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789175557.221695:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175557.221700:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.221740:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.221756:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 6 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.221772:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73467e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876086274204544:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175557.221877:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175557.224798:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73467e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1876086274204544:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175557.224830:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.226682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.227242:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148800 00000100:00100000:0.0:1789175557.227258:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148800 00002000:00100000:0.0:1789175557.227313:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97e73467e300 x1876086251148800/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:728/0 lens 504/0 e 0 to 0 dl 1789175568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175557.227325:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e73467e300 with x1876086251148800 ext(0->8) 00010000:00010000:0.0:1789175557.227335:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 7 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.227384:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 7 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175557.227393:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e73467e300 00000100:00100000:0.0:1789175557.227425:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1789175557.227435:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251148800:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:0.0:1789175557.227926:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251148800:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 491us (1253us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789175557.227934:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:0.0:1789175557.227940:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97e73467e300 x1876086251148800/t4294967308(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:728/0 lens 504/448 e 0 to 0 dl 1789175568 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789175557.227949:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e73467e300 with x1876086251148800 ext(0->8) 00010000:00010000:0.0:1789175557.227956:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.227980:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175557.227987:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97e73467e300 00000100:00100000:3.0:1789175557.231101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.231222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251148928 00000100:00100000:2.0:1789175557.231242:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251148928 00010000:00010000:2.0:1789175557.231295:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175557.231336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:2.0:1789175557.231383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251148928:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175557.231401:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789175557.231438:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789175557.231441:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789175557 00002000:00010000:2.0:1789175557.231443:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789175557 00002000:00010000:2.0:1789175557.231445:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789175557 00010000:00010000:2.0:1789175557.231452:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.231465:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.231491:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fcc2dcc/0x1112cdeac4c173db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e9a expref: 9 pid: 6685 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.231508:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175557.231512:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789175557.231518:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.231528:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.231559:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175557.231606:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251148928:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 225us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.231613:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00010000:00010000:3.0:1789175557.232118:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232145:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232173:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232182:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232191:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232198:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175557.232202:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232210:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232223:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.232259:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee38dcef/0x1112cdeac4c1741a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.232323:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251148672:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 10715us (11380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175557.232332:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1789175557.236438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.236599:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251149184 00000100:00100000:0.0:1789175557.236609:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251149184 00000100:00100000:0.0:1789175557.236684:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1789175557.236696:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+43:11593:x1876086251149184:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1789175557.236762:0:11956:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eaf expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175557.236999:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789175557.237044:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789175557.237419:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1789175557.237475:0:11956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.237492:0:11956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.237501:0:11956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.237541:0:11956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.237557:0:11956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 47 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.237586:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274204672:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175557.237666:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546540 going to sleep for 11 seconds 00000100:00100000:1.0:1789175557.241595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.241702:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11956:1876086274204672:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175557.241731:0:11956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.241888:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251149312 00000100:00100000:3.0:1789175557.241895:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251149312 00010000:00010000:3.0:1789175557.241931:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 48 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.241969:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:3.0:1789175557.241979:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+48:2354:x1876086251149312:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175557.241994:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175557.242001:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 48 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242011:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 48 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242031:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c173c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e8c expref: 48 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242058:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:3.0:1789175557.242077:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242086:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242093:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175557.242119:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175557.242450:0:11956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.242457:0:11956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175557.242574:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1789175557.242772:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789175557.242891:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274204800:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789175557.242939:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175557.242981:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e701377480 going to sleep for 11 seconds 00000100:00100000:3.0:1789175557.243257:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+49:2354:x1876086251149312:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1268us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175557.243268:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:1.0:1789175557.243738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274204800 00000100:00100000:1.0:1789175557.243745:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274204800 00000100:00100000:1.0:1789175557.243793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789175557.243802:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274204800:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789175557.243888:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274204800:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 86us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175557.243894:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789175557.243934:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274204800:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789175557.244661:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789175557.244729:0:11956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cf0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274204928:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789175557.244767:0:11956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175557.244798:0:11956:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e708546540 going to sleep for 11 seconds 00000100:00100000:3.0:1789175557.244964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274204928 00000100:00100000:3.0:1789175557.244970:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274204928 00000100:00100000:3.0:1789175557.245012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175557.245020:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11956:x1876086274204928:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789175557.245202:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11956:x1876086274204928:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 182us (432us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789175557.245210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789175557.245732:0:11956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cf0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11956:1876086274204928:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789175557.245788:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789175557.245830:0:11956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245841:0:11956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245849:0:11956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245872:0:11956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175557.245877:0:11956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245885:0:11956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245902:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:1.0:1789175557.245906:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789175557.245911:0:11956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.245918:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17421 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789175557.246115:0:11956:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789175557.246224:0:11956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1789175557.246628:0:11956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342205285910ns, next at 343205282433ns, rc = 0 00000001:00080000:1.0:1789175557.246637:0:11956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789175557.246674:0:11956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec900) 00010000:00010000:1.0:1789175557.246678:0:11956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789175557.246686:0:11956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c1740c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eaf expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175557.246789:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+50:11593:x1876086251149184:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 10095us (10360us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789175557.246798:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000020:00080000:1.0:1789175557.246804:0:11956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789175557.251005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.251205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251149440 00000100:00100000:0.0:1789175557.251214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251149440 00000100:00100000:0.0:1789175557.251285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:0.0:1789175557.251294:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+50:11593:x1876086251149440:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175557.251316:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175557.251337:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c17428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2eb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.251426:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c17428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eb6 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.251453:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c17428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eb6 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.251472:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.251475:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175557.251479:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668600, rc 0) 00000100:00100000:0.0:1789175557.251529:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+51:11593:x1876086251149440:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 236us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.251537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:2.0:1789175557.255564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.255670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251149696 00000100:00100000:0.0:1789175557.255679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251149696 00000100:00100000:0.0:1789175557.255741:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1789175557.255751:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+51:11593:x1876086251149696:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175557.256134:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+52:11593:x1876086251149696:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 372us (569us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789175557.256142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1789175557.351590:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.351832:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251149824 00000100:00100000:0.0:1789175557.351842:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251149824 00000100:00100000:0.0:1789175557.351938:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:0.0:1789175557.351948:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+52:11603:x1876086251149824:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1789175557.352021:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352038:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352079:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352096:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352102:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352107:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352229:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352238:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352245:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789175557.352311:0:8054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352323:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352330:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352338:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352394:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.352398:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352404:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352413:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175557.352415:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.352418:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352422:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c1742f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352432:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352435:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352439:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352442:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.352443:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352447:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352457:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175557.352459:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.352460:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352463:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c17436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352474:0:8054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352478:0:8054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352481:0:8054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352484:0:8054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.352485:0:8054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352488:0:8054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352492:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.352493:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.352494:0:8054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.352497:0:8054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c1743d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.352572:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+52:11603:x1876086251149824:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 624us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.352580:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:1.0:1789175557.388774:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.388890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251150080 00000100:00100000:0.0:1789175557.388901:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251150080 00000100:00100000:0.0:1789175557.388968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:0.0:1789175557.388979:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+52:11606:x1876086251150080:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175557.389002:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175557.389027:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ebd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389118:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389147:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389160:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389175:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389182:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389188:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389377:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389388:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389395:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175557.389407:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789175557.389526:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389534:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389540:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389546:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.389551:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389558:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389572:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175557.389575:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.389580:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389598:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c1744b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389613:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389618:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389624:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389628:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.389631:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389638:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389646:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175557.389649:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.389652:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389658:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c17452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389706:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389722:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.389736:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.389738:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175557.389741:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:0.0:1789175557.389805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+54:11606:x1876086251150080:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 828us (1040us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789175557.389814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:2.0:1789175557.394186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.394378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251150208 00000100:00100000:0.0:1789175557.394389:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251150208 00000100:00100000:0.0:1789175557.394441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:0.0:1789175557.394452:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+54:11606:x1876086251150208:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1789175557.394518:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394535:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394548:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394574:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394582:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394589:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394595:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.394606:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394614:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394626:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.394629:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175557.394633:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.394639:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c17467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.394727:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+54:11606:x1876086251150208:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 276us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.394736:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:1.0:1789175557.398554:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.398637:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251150464 00000100:00100000:0.0:1789175557.398647:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251150464 00000100:00100000:0.0:1789175557.398709:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:0.0:1789175557.398720:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+54:11606:x1876086251150464:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1789175557.398976:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+55:11606:x1876086251150464:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 258us (432us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789175557.398984:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1789175557.483657:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.483886:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251150720 00000100:00100000:0.0:1789175557.483897:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251150720 00000100:00100000:0.0:1789175557.483961:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:0.0:1789175557.483972:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+55:11616:x1876086251150720:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175557.483995:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175557.484013:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789175557.484040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c173e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ea1 expref: 55 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175557.484074:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175557.484087:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1746e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ec4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484202:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484218:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484227:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484273:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.484285:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 55 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.484298:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274205056:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175557.484458:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175557.488888:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.488979:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251150848 00000100:00100000:2.0:1789175557.488989:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251150848 00010000:00010000:2.0:1789175557.489031:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 56 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175557.489099:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1789175557.489110:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+56:2353:x1876086251150848:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175557.489138:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175557.489146:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 56 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.489160:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 56 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.489184:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.489189:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.489199:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.489207:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.489230:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175557.489306:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+56:2353:x1876086251150848:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 197us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.489314:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00010000:00010000:0.0:1789175557.489733:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c17459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ebd expref: 55 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.489773:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274205056:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175557.489797:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.489809:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.489816:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175557.489834:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789175557.489990:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1746e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.490007:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.490015:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.490018:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789175557.490020:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669800, rc 0) 00000100:00100000:0.0:1789175557.490070:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+55:11616:x1876086251150720:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6100us (6423us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789175557.490077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:3.0:1789175557.494089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.494178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151104 00000100:00100000:0.0:1789175557.494187:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151104 00000100:00100000:0.0:1789175557.494253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:0.0:1789175557.494263:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+55:11616:x1876086251151104:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1789175557.494562:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.494578:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.494589:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175557.494635:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1789175557.494656:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050e6319f reply state 0000000026f74a69 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175557.494664:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175557.494759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+58:11616:x1876086251151104:12345-192.168.201.18@tcp:36:bash.0 Request processed in 496us (678us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789175557.494766:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 208 00000020:00080000:0.0:1789175557.494771:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175557.496753:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496787:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496795:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496802:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175557.496807:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496815:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496833:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.496836:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175557.496841:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.496846:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c17483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.499458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.499572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151232 00000100:00100000:2.0:1789175557.499583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151232 00000100:00100000:2.0:1789175557.499651:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:2.0:1789175557.499663:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+57:11616:x1876086251151232:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175557.499688:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175557.499712:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c1748a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ecb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.499806:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.499838:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.499848:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.499884:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.499899:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 58 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175557.499914:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274205184:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175557.500001:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baade40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175557.503827:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274205184:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175557.503860:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175557.505866:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175557.505948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151360 00000100:00100000:1.0:1789175557.505957:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151360 00010000:00010000:1.0:1789175557.505999:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 59 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175557.506054:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:1.0:1789175557.506071:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+59:2353:x1876086251151360:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175557.506089:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175557.506096:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 59 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506108:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 59 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506144:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669800/0x1112cdeac4c17475 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ec4 expref: 59 pid: 5838 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506162:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175557.506167:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506176:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506184:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.506233:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175557.506383:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+58:2353:x1876086251151360:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 314us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175557.506392:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00010000:00010000:2.0:1789175557.506473:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.506482:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175557.506535:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789175557.506540:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175557.506562:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.506608:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c1748a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.506623:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.506631:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.506633:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175557.506636:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4a00, rc 0) 00000100:00100000:2.0:1789175557.506663:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+57:11616:x1876086251151232:12345-192.168.201.18@tcp:101:bash.0 Request processed in 7003us (7216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.506669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:1.0:1789175557.510797:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.510883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151616 00000100:00100000:0.0:1789175557.510892:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151616 00000100:00100000:0.0:1789175557.510970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1789175557.510979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+57:11616:x1876086251151616:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:0.0:1789175557.511534:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+58:11616:x1876086251151616:12345-192.168.201.18@tcp:35:bash.0 Request processed in 554us (745us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789175557.511543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1789175557.583278:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.583539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151744 00000100:00100000:2.0:1789175557.583549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151744 00000100:00100000:2.0:1789175557.583614:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:2.0:1789175557.583624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+58:11622:x1876086251151744:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175557.583649:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175557.583671:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ed2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583734:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583749:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583760:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175557.583812:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789175557.583815:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175557.583832:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583856:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c17498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed2 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583875:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed2 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.583884:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:2.0:1789175557.583886:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175557.583890:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5800, rc 0) 00000100:00100000:2.0:1789175557.583961:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251151744:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 339us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.583968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:3.0:1789175557.591231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.591387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251151872 00000100:00100000:0.0:1789175557.591398:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251151872 00000100:00100000:0.0:1789175557.591461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:0.0:1789175557.591487:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251151872:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175557.591507:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175557.591530:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c174a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ed9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591593:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591609:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591619:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591636:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591643:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591648:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591734:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591742:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591748:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175557.591793:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789175557.591797:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175557.591818:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591831:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591839:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591846:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591853:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591859:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.591863:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591871:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591883:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175557.591886:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.591890:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591896:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591918:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591924:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591930:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591935:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175557.591938:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591945:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591953:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175557.591955:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175557.591958:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591963:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669000/0x1112cdeac4c174b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.591996:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c174a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed9 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.592009:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed9 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.592028:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175557.592030:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175557.592033:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669e00, rc 0) 00000100:00100000:0.0:1789175557.592105:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11622:x1876086251151872:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 621us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.592112:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:3.0:1789175557.596291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.596403:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152000 00000100:00100000:2.0:1789175557.596413:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152000 00000100:00100000:2.0:1789175557.596474:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1789175557.596483:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+60:2355:x1876086251152000:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175557.596498:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175557.596519:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c174bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed9 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.596541:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.596559:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175557.596612:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+59:2355:x1876086251152000:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 130us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.596619:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1789175557.599015:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.599092:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152256 00000100:00100000:2.0:1789175557.599100:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152256 00000100:00100000:2.0:1789175557.599169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:2.0:1789175557.599179:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251152256:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175557.599204:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175557.599225:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ee0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.599379:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.599396:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.599406:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.599446:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.599458:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 60 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175557.599472:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274205312:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175557.599583:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73baade40 going to sleep for 11 seconds 00010000:00010000:3.0:1789175557.601654:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175557.604187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175557.604289:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152384 00000100:00100000:1.0:1789175557.604297:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152384 00010000:00010000:1.0:1789175557.604369:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 61 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175557.604410:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:1.0:1789175557.604420:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+61:2354:x1876086251152384:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175557.604438:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175557.604445:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 61 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.604459:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 61 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.604480:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175557.604485:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.604495:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.604504:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.604536:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175557.604587:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+61:2354:x1876086251152384:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 168us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175557.604595:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00010000:00010000:2.0:1789175557.605106:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ecb expref: 60 pid: 5840 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175557.605137:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274205312:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175557.605158:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.605167:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.605172:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175557.605192:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789175557.605453:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.605469:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.605476:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.605479:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789175557.605482:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5c00, rc 0) 00000100:00100000:2.0:1789175557.605601:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11622:x1876086251152256:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 6423us (6594us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789175557.605609:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:3.0:1789175557.609951:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175557.610011:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152640 00000100:00100000:2.0:1789175557.610033:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152640 00000100:00100000:2.0:1789175557.610133:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1789175557.610144:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707445050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11622:x1876086251152640:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:2.0:1789175557.610162:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175557.610187:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668600/0x1112cdeac4c17428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eb6 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175557.610206:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175557.610211:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175557.610731:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707445050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251152640:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 587us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175557.610739:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1789175557.613033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175557.613296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152768 00000100:00100000:0.0:1789175557.613306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152768 00000100:00100000:0.0:1789175557.613541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:0.0:1789175557.613553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251152768:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:0.0:1789175557.613677:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.613697:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175557.613709:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175557.613896:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789175557.613980:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251152768:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 428us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175557.613988:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:0.0:1789175557.616891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175557.616994:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251152896 00000100:00100000:1.0:1789175557.617005:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251152896 00000100:00100000:1.0:1789175557.617109:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:1.0:1789175557.617132:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+59:11622:x1876086251152896:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1789175557.617153:0:8054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175557.617174:0:8054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ee7 expref: -99 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617233:0:8054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617256:0:8054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 60 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617277:0:8054:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617291:0:8054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 60 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617304:0:8054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175557.617307:0:8054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175557.617311:0:8054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 60 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175557.617334:0:8054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031e00, rc 0) 00000100:00100000:1.0:1789175557.617677:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11622:x1876086251152896:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 558us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175557.617685:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 214 00000040:00080000:1.0:1789175558.055818:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175558.055828:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175558.055867:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789175558.055872:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175558.055998:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274205440:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175558.056104:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789175558.074805:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7071d4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274205440:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789175558.082854:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.082961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251153024 00000100:00100000:0.0:1789175558.082970:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251153024 00000100:00100000:0.0:1789175558.083075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:0.0:1789175558.083089:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11623:x1876086251153024:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789175558.083140:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789175558.083259:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11623:x1876086251153024:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 173us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.083267:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00080000:2.0:1789175558.083620:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175558.091652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.092268:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251153152 00000100:00100000:2.0:1789175558.092279:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251153152 00000100:00100000:2.0:1789175558.092401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:2.0:1789175558.092413:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11623:x1876086251153152:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789175558.092488:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092503:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092515:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092531:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092557:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092564:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092589:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092596:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092600:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175558.092636:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789175558.092639:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175558.092648:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092656:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092660:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092665:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092669:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175558.092672:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092682:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092691:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:2.0:1789175558.092693:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175558.092697:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092701:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4000/0x1112cdeac4c174e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092711:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092715:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092719:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092721:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175558.092723:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092726:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092730:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97e7181cda00) 00010000:00010000:2.0:1789175558.092731:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175558.092732:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092741:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c174ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092751:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092754:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092758:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092761:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175558.092763:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092766:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092770:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175558.092771:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175558.092773:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.092776:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c174f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.092842:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11623:x1876086251153152:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 432us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.092847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:1.0:1789175558.096449:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.096503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251153408 00000100:00100000:0.0:1789175558.096513:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251153408 00000100:00100000:0.0:1789175558.096579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:0.0:1789175558.096590:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+60:11623:x1876086251153408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.096612:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175558.096636:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c174fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2eee expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096743:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096770:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175558.096782:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789175558.096888:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096895:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096917:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096923:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.096927:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096935:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096947:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175558.096950:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789175558.096955:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.096960:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.097000:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c174fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eee expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.097007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:0.0:1789175558.097009:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175558.097012:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c174fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2eee expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.097019:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668200, rc 0) 00000100:00100000:0.0:1789175558.097083:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251153408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 494us (644us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1789175558.097099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:3.0:1789175558.100106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.101218:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251153536 00000100:00100000:2.0:1789175558.101229:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251153536 00000100:00100000:2.0:1789175558.101294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:2.0:1789175558.101304:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251153536:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175558.101334:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175558.101466:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251153536:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 163us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.101475:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:1.0:1789175558.105966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.106444:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251153792 00000100:00100000:0.0:1789175558.106457:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251153792 00000100:00100000:0.0:1789175558.106652:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:0.0:1789175558.106666:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251153792:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.106690:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175558.106693:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789175558.106724:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5800/0x1112cdeac4c1749f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ed2 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.106745:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175558.106751:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175558.106767:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c1750f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2ef5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175558.107325:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789175558.107581:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.107596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.107607:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.107653:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668200/0x1112cdeac4c1750f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ef5 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.107688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ef5 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.107696:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175558.107699:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175558.107701:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175558.107762:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+62:11623:x1876086251153792:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1099us (1806us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789175558.107769:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:1.0:1789175558.112010:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.112295:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154048 00000100:00100000:0.0:1789175558.112308:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154048 00000100:00100000:0.0:1789175558.112394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:0.0:1789175558.112405:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+62:11623:x1876086251154048:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.112473:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175558.112503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ef5 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112533:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175558.112545:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175558.112566:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112580:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112590:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112619:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112627:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112633:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112702:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112709:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112715:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112721:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.112725:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112733:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112740:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175558.112744:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175558.112747:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112754:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c17524 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112769:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112775:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112781:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112786:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.112789:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112795:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112802:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x72f38270 (ffff97e7102eca00) 00010000:00010000:0.0:1789175558.112804:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175558.112806:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.112812:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669400/0x1112cdeac4c1752b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x72f38270 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.112901:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251154048:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 497us (900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175558.112909:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:1.0:1789175558.116429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.116531:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154176 00000100:00100000:3.0:1789175558.116541:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154176 00000100:00100000:3.0:1789175558.116598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:3.0:1789175558.116609:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+61:11623:x1876086251154176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175558.116629:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175558.116653:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2efc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116690:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116705:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116717:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116822:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116842:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.116851:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:3.0:1789175558.116854:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789175558.116866:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8e00, rc 0) 00000100:00100000:3.0:1789175558.116933:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+62:11623:x1876086251154176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 324us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175558.116940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:3.0:1789175558.122400:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175558.122673:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154432 00000100:00100000:1.0:1789175558.122683:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154432 00000100:00100000:1.0:1789175558.122748:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:1.0:1789175558.122758:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+62:11623:x1876086251154432:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789175558.122852:0:8054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.122868:0:8054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.122879:0:8054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789175558.123287:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789175558.123297:0:8054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343081954975ns, next at 344081952802ns, rc = 0 00000004:00010000:1.0:1789175558.123428:0:8054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d6d1fbc reply state 000000004b47a29a transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.123438:0:8054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789175558.123621:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+64:11623:x1876086251154432:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 862us (1231us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789175558.123629:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 222 00010000:00010000:0.0:1789175558.127814:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127853:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127861:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127868:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.127873:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127881:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127898:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:0.0:1789175558.127901:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789175558.127907:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.127914:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.129146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.129454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154560 00000100:00100000:2.0:1789175558.129464:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154560 00000100:00100000:2.0:1789175558.129528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:2.0:1789175558.129541:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+63:11623:x1876086251154560:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175558.129566:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175558.129586:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.129642:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.129657:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.129676:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:2.0:1789175558.129680:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175558.129683:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5000, rc 0) 00000100:00100000:2.0:1789175558.129736:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73467f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+64:11623:x1876086251154560:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 198us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.129756:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:1.0:1789175558.133788:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.133881:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154688 00000100:00100000:3.0:1789175558.133892:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154688 00000100:00100000:3.0:1789175558.133976:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:3.0:1789175558.133986:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251154688:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789175558.134943:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251154688:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 955us (1164us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789175558.134953:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00080000:2.0:1789175558.135182:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175558.138473:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.138655:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251154944 00000100:00100000:2.0:1789175558.138666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251154944 00000100:00100000:2.0:1789175558.138764:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1789175558.138775:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+64:11623:x1876086251154944:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789175558.139035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+65:11623:x1876086251154944:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 261us (573us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789175558.139051:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1789175558.141916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.142024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155200 00000100:00100000:0.0:1789175558.142034:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155200 00000100:00100000:0.0:1789175558.142108:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:0.0:1789175558.142129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+65:11623:x1876086251155200:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789175558.142257:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+65:11623:x1876086251155200:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 130us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.142264:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:3.0:1789175558.145711:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.145891:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155328 00000100:00100000:0.0:1789175558.145913:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155328 00000100:00100000:0.0:1789175558.145977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:0.0:1789175558.145989:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+65:11623:x1876086251155328:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.146008:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175558.146028:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1754e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146131:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146156:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146168:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175558.146206:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175558.146224:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146262:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669a00/0x1112cdeac4c1754e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f0a expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f0a expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.146288:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:0.0:1789175558.146291:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789175558.146295:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175558.146403:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+66:11623:x1876086251155328:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 416us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.146417:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:0.0:1789175558.150426:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.150511:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155456 00000100:00100000:3.0:1789175558.150531:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155456 00000100:00100000:3.0:1789175558.150597:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1789175558.150608:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251155456:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175558.150628:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175558.150652:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f11 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175558.150679:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a706, blocks: 0x1 00010000:00010000:3.0:1789175558.150698:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789175558.150716:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175558.150727:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.150747:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.150761:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8800, rc 0) 00000100:00100000:3.0:1789175558.150818:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251155456:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 213us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175558.150825:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:0.0:1789175558.156282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.156551:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155712 00000100:00100000:2.0:1789175558.156562:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155712 00000100:00100000:2.0:1789175558.156626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:2.0:1789175558.156637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+66:11623:x1876086251155712:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789175558.156758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+66:11623:x1876086251155712:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.156766:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:3.0:1789175558.161891:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.162007:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155840 00000100:00100000:0.0:1789175558.162018:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155840 00000100:00100000:0.0:1789175558.162104:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:0.0:1789175558.162128:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:11623:x1876086251155840:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.162146:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175558.162163:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f18 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.162194:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.162202:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175558.162206:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175558.162211:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.162253:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.162266:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.162279:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274205568:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175558.162417:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7199ec9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175558.165991:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274205568:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175558.166025:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.166055:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668600, rc 0) 00000100:00100000:2.0:1789175558.166121:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:11623:x1876086251155840:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3987us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.166131:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:2.0:1789175558.167583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.167730:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251155968 00000100:00100000:0.0:1789175558.167740:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251155968 00010000:00010000:0.0:1789175558.167787:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.167831:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:0.0:1789175558.167840:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2353:x1876086251155968:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175558.167861:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175558.167886:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.167900:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.167923:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c1755c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f11 expref: 10 pid: 6686 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.167939:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175558.167943:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175558.167952:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.167963:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.168021:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.168036:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1876086274205696:192.168.201.18@tcp:105: 00000100:00100000:0.0:1789175558.168146:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7199ec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175558.173065:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1876086274205696:192.168.201.18@tcp:105: 00010000:00010000:0.0:1789175558.173094:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175558.173161:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251155968:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 5322us (5586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.173172:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1789175558.177607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.177790:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156096 00000100:00100000:3.0:1789175558.177801:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156096 00002000:00100000:3.0:1789175558.177853:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97e72643f800 x1876086251156096/t0(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:729/0 lens 504/0 e 0 to 0 dl 1789175569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175558.177863:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72643f800 with x1876086251156096 ext(0->12) 00002000:00010000:3.0:1789175558.177869:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72643f800 00000100:00100000:3.0:1789175558.177907:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175558.177917:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2353:x1876086251156096:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789175558.178447:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+11:2353:x1876086251156096:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 529us (846us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789175558.178456:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00002000:00100000:3.0:1789175558.178464:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97e72643f800 x1876086251156096/t4294967321(0) o4->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:729/0 lens 504/448 e 0 to 0 dl 1789175569 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789175558.178485:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e72643f800 with x1876086251156096 ext(0->12) 00002000:00010000:3.0:1789175558.178489:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e72643f800 00000100:00100000:3.0:1789175558.182463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.182618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156224 00000100:00100000:0.0:1789175558.182628:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156224 00000100:00100000:0.0:1789175558.182685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:0.0:1789175558.182696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+66:11623:x1876086251156224:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789175558.225759:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1789175558.225810:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789175558.225836:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e7267ff300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789175558.225841:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7344d0400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e70133ab40 00000020:00080000:1.0:1789175558.225845:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7344d0600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e72e1a8c00 00000001:00080000:1.0:1789175558.225866:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789175558.225869:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789175558.225875:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789175558.225886:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e705127300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789175558.225889:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e70548e400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e705127480 00000020:00080000:1.0:1789175558.225892:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e70548e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e72e43b800 00000001:00080000:1.0:1789175558.225906:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:1.0:1789175558.225948:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789175558.226190:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789175558.226593:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175558.226614:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274205824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789175558.226692:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175558.226741:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175558.226749:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274205952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789175558.226776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175558.226805:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274205824 00000100:00100000:0.0:1789175558.226812:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274205824 00000100:00100000:0.0:1789175558.226864:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274205952 00000100:00100000:0.0:1789175558.226868:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274205952 00000100:00100000:0.0:1789175558.226904:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789175558.226912:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274205824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789175558.226940:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1789175558.226968:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.226992:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 10 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.227002:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789175558.227007:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175558.227012:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.227430:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 10 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.227446:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 10 pid: 12165 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.227461:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876086274206080:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175558.227541:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7199ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175558.227562:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789175558.227572:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876086274205952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789175558.227714:0:12165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789175558.227718:0:12165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789175558 00002000:00010000:0.0:1789175558.227727:0:12165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789175558.227729:0:12165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789175558 -> 1789175558 00002000:00010000:0.0:1789175558.227732:0:12165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789175558.227778:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876086274205952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (1001us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789175558.227785:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789175558.227826:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1789175558.227831:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1789175558.227851:0:3307:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff97e7343e2d80 x1876086274205952/t4294967322(4294967322) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789175574 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789175558.227862:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e7343e2d80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789175558.227867:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274205952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789175558.231802:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175558.231825:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274206208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789175558.231893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789175558.231947:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175558.231964:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274206208 00000100:00100000:2.0:1789175558.231971:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274206208 00000100:00100000:2.0:1789175558.232020:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789175558.232032:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876086274206208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789175558.232072:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1789175558.232104:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4a705, atime: 0x6aa4a705, ctime: 0x6aa4a705, blocks: 0x1 00010000:00010000:2.0:1789175558.232123:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.232635:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1789175558.232641:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175558.232648:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.232666:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.232677:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.232684:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.232719:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789175558.233244:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175558.233259:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.233268:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175558.233272:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.233281:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.233299:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.233306:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17571 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.233325:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175558.233327:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175558.233328:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175558.233933:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876086274206208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1901us (2036us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789175558.233944:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789175558.233972:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789175558.234088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11623:x1876086251156224:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 51392us (51852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.234096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:2.0:1789175558.237438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.237470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.237499:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156480 00000100:00100000:2.0:1789175558.237507:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156480 00000100:00100000:3.0:1789175558.237789:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156352 00000100:00100000:3.0:1789175558.237795:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156352 00010000:00010000:3.0:1789175558.237831:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 12 pid: 12165 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.237868:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1789175558.237878:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+12:2354:x1876086251156352:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175558.237894:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175558.237901:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 12 pid: 12165 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.237915:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 12 pid: 12165 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.237941:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175558.237946:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175558.237952:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.237962:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.237999:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175558.238043:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+12:2354:x1876086251156352:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 167us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175558.238063:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00010000:00010000:1.0:1789175558.238392:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ab8496/0x1112cdeac4c1732c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e77 expref: 11 pid: 12165 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.238408:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1876086274206080:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175558.238429:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.238440:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.238454:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.238464:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.238472:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.238486:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175558.239299:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175558.239307:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.239317:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175558.239321:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.239331:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.239385:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.239392:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002451e2c7/0x1112cdeac4c1756a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.239412:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175558.239414:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175558.239415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175558.239632:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:2.0:1789175558.239642:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+10:2353:x1876086251156480:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789175558.240829:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876086274205824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13914us (14134us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789175558.240838:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1789175558.241451:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e7343e0000/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789175558.241460:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274205824:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789175558.243736:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e72643d180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789175558.243751:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274206208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789175558.275091:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.275152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.275185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.275373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156608 00000100:00100000:2.0:1789175558.275385:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156608 00000100:00100000:2.0:1789175558.275445:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 294 00000100:00100000:2.0:1789175558.275456:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251156608:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175558.275541:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251156608:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.275548:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 294 00000100:00100000:2.0:1789175558.275580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156864 00000100:00100000:2.0:1789175558.275583:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156864 00000100:00100000:2.0:1789175558.275625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:2.0:1789175558.275632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251156864:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175558.275673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251156864:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.275680:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00080000:2.0:1789175558.275808:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175558.276930:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251156736 00000100:00100000:0.0:1789175558.276940:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251156736 00000100:00100000:0.0:1789175558.277008:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:0.0:1789175558.277017:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251156736:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:3.0:1789175558.277311:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175558.277385:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251156736:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 367us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.277393:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000001:00080000:0.0:1789175558.283879:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1789175558.283895:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1789175558.283902:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789175558.284063:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251156480:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 44417us (46586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.284075:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:2.0:1789175558.287450:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.287698:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157120 00000100:00100000:3.0:1789175558.287709:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157120 00000100:00100000:3.0:1789175558.287770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:3.0:1789175558.287781:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11623:x1876086251157120:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789175558.287832:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175558.287858:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668800/0x1112cdeac4c17555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f0a expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.287877:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:3.0:1789175558.287882:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175558.287910:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.287923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.287932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789175558.288587:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa789859 reply state 00000000f3438cdc transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.288598:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789175558.288700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+21:11623:x1876086251157120:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 920us (1258us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789175558.288724:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 228 00010000:00010000:2.0:1789175558.290934:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.290952:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.290959:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.290966:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175558.290971:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.290979:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.290996:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:2.0:1789175558.290999:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175558.291004:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.291010:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8400/0x1112cdeac4c17578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.293225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175558.293731:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157248 00000100:00100000:1.0:1789175558.293742:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157248 00000100:00100000:1.0:1789175558.293811:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1789175558.293824:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251157248:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789175558.294095:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789175558.294099:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789175558 -> 1789175557 00002000:00010000:1.0:1789175558.294102:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789175557 00002000:00010000:1.0:1789175558.294104:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789175558 -> 1789175557 00002000:00010000:1.0:1789175558.294119:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789175558.294689:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251157248:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 865us (1472us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789175558.294698:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:2.0:1789175558.298816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.298865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157504 00000100:00100000:3.0:1789175558.298875:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157504 00000100:00100000:3.0:1789175558.298925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:3.0:1789175558.298936:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+20:11623:x1876086251157504:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789175558.299003:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.299017:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.299023:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.299063:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.299078:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 20 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.299091:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734d21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274206336:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175558.299188:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e71141ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175558.301813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175558.301878:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157632 00000100:00100000:1.0:1789175558.301885:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157632 00010000:00010000:1.0:1789175558.301918:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.301950:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1789175558.301956:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2354:x1876086251157632:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175558.301967:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175558.301972:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.301981:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.301999:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:1.0:1789175558.302003:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.302010:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.302016:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.302030:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175558.302086:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2354:x1876086251157632:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175558.302092:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00010000:00010000:3.0:1789175558.302190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c17539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2efc expref: 20 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.302207:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734d21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1876086274206336:192.168.201.18@tcp:104: 00010000:00010000:3.0:1789175558.302245:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302255:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302261:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302291:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302800:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302806:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302812:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175558.302816:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302824:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302836:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:3.0:1789175558.302839:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789175558.302844:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.302850:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8800/0x1112cdeac4c1757f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.302924:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11623:x1876086251157504:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 3989us (4116us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789175558.302933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:2.0:1789175558.304816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.304889:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157760 00000100:00100000:0.0:1789175558.304898:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157760 00000100:00100000:0.0:1789175558.304984:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1789175558.304992:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251157760:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789175558.305027:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.305053:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.305060:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175558.305064:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175558.305067:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.305094:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.305104:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 8 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.305128:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274206464:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175558.305208:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e705047300 going to sleep for 11 seconds 00000100:00100000:0.0:1789175558.307062:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6685:1876086274206464:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175558.307087:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.308766:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175558.308811:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251157888 00000100:00100000:3.0:1789175558.308821:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251157888 00010000:00010000:3.0:1789175558.308852:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175558.308885:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:3.0:1789175558.308895:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+9:2354:x1876086251157888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175558.308911:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175558.308933:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.308943:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.308961:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e9254a6/0x1112cdeac4c17563 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f18 expref: 9 pid: 6685 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.308972:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175558.308975:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789175558.308980:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.309000:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175558.309022:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175558.309088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251157888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 194us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175558.309096:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00010000:00010000:0.0:1789175558.309550:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309569:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309597:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309605:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309613:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309619:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175558.309623:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309632:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309646:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.309654:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724224c4/0x1112cdeac4c17586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.309717:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2354:x1876086251157760:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 4724us (4907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.309726:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:3.0:1789175558.311328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.311742:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251158144 00000100:00100000:2.0:1789175558.311750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251158144 00000100:00100000:2.0:1789175558.311812:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:2.0:1789175558.311820:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11623:x1876086251158144:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789175558.311888:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.311903:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.311911:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.312097:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.312119:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.312128:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.312168:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.312191:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 20 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.312203:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274206592:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175558.312279:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7181e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175558.314704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.314725:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274206592:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175558.314753:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.314801:0:8505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251158272 00000100:00100000:1.0:1789175558.314816:0:8505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251158272 00010000:00010000:1.0:1789175558.314842:0:8505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.314872:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1789175558.314881:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2353:x1876086251158272:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175558.314896:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175558.314903:0:8505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314915:0:8505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314936:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f03 expref: 21 pid: 5840 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314951:0:8505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:1.0:1789175558.314955:0:8505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314963:0:8505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314970:0:8505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.314997:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789175558.315036:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.315052:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175558.315219:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+20:2353:x1876086251158272:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 337us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175558.315244:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000001:00080000:0.0:1789175558.315246:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789175558.315416:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789175558.315464:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789175558.315546:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274206720:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789175558.315590:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175558.315627:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70133ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175558.316289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274206720 00000100:00100000:3.0:1789175558.316295:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274206720 00000100:00100000:3.0:1789175558.316332:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175558.316433:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274206720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789175558.316610:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274206720:12345-0@lo:1000:mdt00_002.0 Request processed in 269us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.316617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789175558.316642:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1789175558.316648:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e7343e2d80, transno 4294967322 00000004:00080000:0.0:1789175558.316661:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e7343e0000, transno 4294967323 00000100:00100000:0.0:1789175558.316668:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274206720:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789175558.317080:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789175558.317162:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274206848:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789175558.317198:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175558.317240:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175558.317310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274206848 00000100:00100000:3.0:1789175558.317314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274206848 00000100:00100000:3.0:1789175558.317371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175558.317378:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876086274206848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789175558.317504:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876086274206848:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (305us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789175558.317521:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789175558.317535:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1876086274206848:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789175558.317566:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317576:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317584:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317590:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.317596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317605:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317620:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7051db200) 00010000:00010000:0.0:1789175558.317623:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175558.317629:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317635:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317664:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317671:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317677:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317691:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.317694:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317699:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317706:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175558.317707:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175558.317713:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317721:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317727:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.317745:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 23 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.317752:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274206976:192.168.201.18@tcp:105: 00000100:00100000:0.0:1789175558.317805:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175558.319599:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1876086274206976:192.168.201.18@tcp:105: 00010000:00010000:0.0:1789175558.319626:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319652:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c174d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319681:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319695:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319705:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319715:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319721:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319726:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319731:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.319734:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319741:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319750:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175558.319753:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175558.319756:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319769:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c1759b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319778:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319785:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319790:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319794:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.319798:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319803:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319810:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175558.319813:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789175558.319815:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.319820:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c1758d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.320080:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+23:11623:x1876086251158144:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 8259us (8757us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789175558.320090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 230 00000020:00080000:0.0:1789175558.320100:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789175558.320240:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175558.320245:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175558.320697:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789175558.320704:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175558.322534:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.322625:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251158400 00000100:00100000:0.0:1789175558.322634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251158400 00000100:00100000:0.0:1789175558.322692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1789175558.322703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+23:11622:x1876086251158400:12345-192.168.201.18@tcp:49:lfs.0 00000100:00100000:0.0:1789175558.322881:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+23:11622:x1876086251158400:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 179us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.322888:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1789175558.323708:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.323788:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251158656 00000100:00100000:0.0:1789175558.323794:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251158656 00000100:00100000:0.0:1789175558.323830:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:0.0:1789175558.323838:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+23:11623:x1876086251158656:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789175558.325232:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789175558.325367:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1789175558.325424:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325444:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325457:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325466:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325472:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325479:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.325504:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789175558.325653:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11623:x1876086251158656:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1811us (1942us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789175558.325663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000020:00080000:0.0:1789175558.325668:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789175558.325683:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175558.325690:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.325696:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175558.325701:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.325709:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.325720:0:6702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97e7102eca00) 00010000:00010000:1.0:1789175558.325723:0:6702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789175558.325728:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.325734:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175558.325750:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175558.325752:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175558.325753:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175558.325786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.325949:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251158912 00000100:00100000:0.0:1789175558.325956:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251158912 00000100:00100000:0.0:1789175558.326076:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:0.0:1789175558.326086:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11622:x1876086251158912:12345-192.168.201.18@tcp:58:lfs.0 00000040:00080000:0.0:1789175558.326266:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789175558.326327:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11622:x1876086251158912:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 242us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.326334:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:3.0:1789175558.356961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.359573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251159040 00000100:00100000:0.0:1789175558.359589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251159040 00000100:00100000:0.0:1789175558.359661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:0.0:1789175558.359674:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+25:11625:x1876086251159040:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175558.359703:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175558.359724:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c175a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f1f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359806:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359838:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359855:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359863:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.359869:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.360087:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.360098:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.360118:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.360153:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.360167:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 26 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175558.360181:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274207104:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175558.360287:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1789175558.367150:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1876086274207104:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175558.367182:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.367304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175558.367378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251159296 00000100:00100000:0.0:1789175558.367385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251159296 00000100:00100000:0.0:1789175558.367444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1789175558.367453:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+27:5593:x1876086251159296:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789175558.367682:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+28:5593:x1876086251159296:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 228us (378us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789175558.367689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:3.0:1789175558.372886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175558.373068:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251159424 00000100:00100000:2.0:1789175558.373079:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251159424 00010000:00010000:2.0:1789175558.373127:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 28 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175558.373319:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1789175558.373496:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+28:2353:x1876086251159424:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175558.373517:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175558.373525:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 28 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373540:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 28 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373585:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5c00/0x1112cdeac4c174c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee0 expref: 28 pid: 5839 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373602:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175558.373607:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373617:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373625:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175558.373647:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175558.373705:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+27:2353:x1876086251159424:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 224us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175558.373713:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00010000:00010000:0.0:1789175558.375255:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375272:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175558.375322:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789175558.375327:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175558.375368:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375385:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375395:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375400:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375424:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375429:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.375433:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375439:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375452:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:0.0:1789175558.375455:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175558.375459:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375465:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669c00/0x1112cdeac4c175b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375478:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375484:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375489:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375493:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175558.375496:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375510:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375518:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97e7102ecd00) 00010000:00010000:0.0:1789175558.375520:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175558.375523:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375527:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668a00/0x1112cdeac4c175b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375568:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668e00/0x1112cdeac4c175a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f1f expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375581:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f1f expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175558.375587:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175558.375590:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175558.375592:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668000, rc 0) 00000100:00100000:0.0:1789175558.375644:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11625:x1876086251159040:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 15971us (18691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175558.375652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00010000:00010000:3.0:1789175558.627514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175559.160059:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175559.160070:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175559.160287:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789175559.160296:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789175559.329609:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175559.329620:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175559.329664:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789175559.329671:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175559.329809:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274207232:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789175559.330538:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7199ecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789175559.338575:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175559.338603:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876086274207232:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789175559.338812:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251159552 00000100:00100000:2.0:1789175559.338820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251159552 00000100:00100000:2.0:1789175559.338883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:2.0:1789175559.338894:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11637:x1876086251159552:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175559.338930:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175559.339037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11637:x1876086251159552:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 146us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175559.339043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:3.0:1789175559.342196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175559.342796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251159808 00000100:00100000:2.0:1789175559.342810:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251159808 00000100:00100000:2.0:1789175559.342870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:2.0:1789175559.342879:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+26:11637:x1876086251159808:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175559.342898:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175559.342918:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c175c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.343020:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c175cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.343210:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c175cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.343277:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c175cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175559.343290:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789175559.343492:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c175c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f26 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.343510:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c175cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f26 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.343519:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175559.343522:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175559.343525:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4800, rc 0) 00000100:00100000:2.0:1789175559.343643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+28:11637:x1876086251159808:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 764us (1458us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789175559.343651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:3.0:1789175559.347484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175559.347571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160064 00000100:00100000:2.0:1789175559.347596:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160064 00000100:00100000:2.0:1789175559.347644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:2.0:1789175559.347655:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+28:11637:x1876086251160064:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789175559.347736:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347754:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347767:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347967:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347975:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347982:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.347988:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175559.347993:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.348003:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.348015:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175559.348018:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175559.348022:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.348064:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c175da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175559.348250:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11637:x1876086251160064:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 596us (774us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789175559.348259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 235 00000040:00080000:3.0:1789175559.349505:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789175559.349512:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789175559.349972:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789175559.349982:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789175559.353914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175559.353983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175559.354080:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160448 00000100:00100000:2.0:1789175559.354099:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160448 00000100:00100000:2.0:1789175559.354166:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175559.354177:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707447c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+29:2354:x1876086251160448:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175559.354194:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175559.354230:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c175cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f26 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175559.354250:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:2.0:1789175559.354256:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175559.354311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707447c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+28:2354:x1876086251160448:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175559.354319:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1789175559.354635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160320 00000100:00100000:0.0:1789175559.354641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160320 00000100:00100000:0.0:1789175559.354672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:0.0:1789175559.354679:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+28:11637:x1876086251160320:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789175559.354904:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11637:x1876086251160320:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 225us (1001us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789175559.354911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00010000:00010000:1.0:1789175559.649590:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175560.677457:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175561.064512:0:12560:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789175561.064522:0:12560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789175561.067176:0:12560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789175561.067187:0:12560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789175561.125098:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175561.125256:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175561.128906:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274207360 00000100:00100000:2.0:1789175561.128919:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274207360 00000100:00080000:0.0:1789175561.129080:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175561.129119:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789175561.129131:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274207360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175561.129174:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175561.129374:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274207360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175561.129382:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789175561.129476:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175561.301854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175561.301925:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160704 00000100:00100000:0.0:1789175561.301938:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160704 00000100:00100000:0.0:1789175561.302029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:0.0:1789175561.302041:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+29:11657:x1876086251160704:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175561.302081:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175561.302104:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c175e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f2d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.302219:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c175e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.302234:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c175e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.302248:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c175e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175561.302259:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789175561.302425:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669e00/0x1112cdeac4c175e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f2d expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.302444:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c175e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f2d expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.302470:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:0.0:1789175561.302473:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789175561.302477:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668c00, rc 0) 00000100:00100000:0.0:1789175561.302535:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11657:x1876086251160704:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 497us (694us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789175561.302543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00080000:3.0:1789175561.303252:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175561.307837:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175561.307939:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160832 00000100:00100000:3.0:1789175561.307950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160832 00000100:00100000:3.0:1789175561.308016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:3.0:1789175561.308026:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11657:x1876086251160832:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1789175561.308101:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308128:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308140:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308169:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308487:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308497:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308503:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175561.308508:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308527:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308539:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:3.0:1789175561.308542:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789175561.308547:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175561.308553:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8e00/0x1112cdeac4c175f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175561.308737:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+31:11657:x1876086251160832:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 711us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175561.308746:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:0.0:1789175561.376262:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175561.376774:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251160960 00000100:00100000:3.0:1789175561.376784:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251160960 00000100:00100000:0.0:1789175561.376961:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1789175561.376972:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2353:x1876086251160960:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:0.0:1789175561.376990:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175561.377012:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c175fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f34 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789175561.377038:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4a705, atime: 0x6aa4a705, ctime: 0x6aa4a705, blocks: 0xb 00010000:00010000:0.0:1789175561.377256:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1789175561.377262:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175561.377272:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c175fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f34 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.377293:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c175fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f34 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175561.377307:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669e00, rc 0) 00000100:00100000:0.0:1789175561.377392:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251160960:12345-192.168.201.18@tcp:101:cat.0 Request processed in 421us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175561.377416:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00080000:3.0:1789175561.379676:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175561.384072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175561.384466:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161088 00000100:00100000:3.0:1789175561.384478:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161088 00002000:00100000:2.0:1789175561.384669:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97e602d34a80 x1876086251161088/t0(0) o3->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:732/0 lens 488/0 e 0 to 0 dl 1789175572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789175561.384682:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e602d34a80 with x1876086251161088 ext(0->4095) 00002000:00010000:2.0:1789175561.384688:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e602d34a80 00000100:00100000:2.0:1789175561.384750:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1789175561.384759:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251161088:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:2.0:1789175561.384978:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2354:x1876086251161088:12345-192.168.201.18@tcp:3:cat.0 Request processed in 220us (932us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789175561.384985:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00002000:00100000:2.0:1789175561.384992:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97e602d34a80 x1876086251161088/t0(0) o3->5b56eceb-e538-4909-8f73-c533ee4baa44@192.168.201.18@tcp:732/0 lens 488/4536 e 0 to 0 dl 1789175572 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789175561.385000:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97e602d34a80 with x1876086251161088 ext(0->4095) 00002000:00010000:2.0:1789175561.385004:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97e602d34a80 00000100:00100000:2.0:1789175561.635279:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274207488:0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175561.635427:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274208000:0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635454:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175561.635482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175561.635488:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274207872:0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635512:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175561.635566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274207488 00000100:00100000:2.0:1789175561.635574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274207488 00000100:00100000:2.0:1789175561.635619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789175561.635629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274207488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635680:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274207488:12345-0@lo:400:kworker.0 Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175561.635687:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789175561.635722:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208000 00000100:00100000:2.0:1789175561.635725:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208000 00000100:00100000:2.0:1789175561.635760:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789175561.635766:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876086274208000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635799:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876086274208000:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175561.635805:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789175561.635840:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274207488:0@lo:400:kworker.0 00000100:00100000:2.0:1789175561.635853:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274208000:0@lo:400:kworker.0 00000100:00080000:3.0:1789175561.636614:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175561.637411:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274207616:0@lo:400:kworker.0 00000100:00100000:0.0:1789175561.637470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175561.637501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274208128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175561.637528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175561.637575:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789175561.637585:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274207744:0@lo:400:kworker.0 00000100:00100000:0.0:1789175561.637610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175561.637656:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274207872 00000100:00100000:0.0:1789175561.637664:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274207872 00000100:00100000:3.0:1789175561.637670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208128 00000100:00100000:3.0:1789175561.637685:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208128 00000100:00100000:0.0:1789175561.637730:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274207616 00000100:00100000:0.0:1789175561.637737:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274207616 00000100:00100000:3.0:1789175561.637760:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789175561.637763:0:8054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274207744 00000100:00100000:0.0:1789175561.637768:0:8054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274207744 00000100:00100000:3.0:1789175561.637778:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876086274208128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175561.637792:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789175561.637800:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274207872:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789175561.637833:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175561.637862:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274207872:12345-0@lo:400:kworker.0 Request processed in 61us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175561.637871:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789175561.637886:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789175561.637892:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274207616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175561.637920:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274207616:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175561.637926:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789175561.637936:0:8054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789175561.637941:0:8054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274207744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175561.638151:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274207872:0@lo:400:kworker.0 00000100:00100000:1.0:1789175561.638199:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274207616:0@lo:400:kworker.0 00000100:00080000:1.0:1789175561.638236:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175561.638405:0:8054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7071d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274207744:12345-0@lo:400:kworker.0 Request processed in 462us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175561.638413:0:8054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789175561.639692:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876086274208128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1910us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175561.639704:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274207744:0@lo:400:kworker.0 00000100:00100000:3.0:1789175561.639716:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789175561.639743:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7077b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274208128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789175561.697534:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789175562.197251:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1789175562.198078:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1789175562.723430:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175563.397734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175563.397777:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175563.397814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175563.397853:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175563.397880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175563.397911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161728 00000100:00100000:2.0:1789175563.397920:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161728 00000100:00100000:2.0:1789175563.397979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161344 00000100:00100000:2.0:1789175563.397982:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161344 00000100:00100000:2.0:1789175563.398006:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:2.0:1789175563.398016:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251161728:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175563.398119:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2353:x1876086251161728:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175563.398127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:3.0:1789175563.398163:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161216 00000100:00100000:3.0:1789175563.398174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161216 00000100:00100000:3.0:1789175563.398204:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 296 00000100:00100000:3.0:1789175563.398212:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251161216:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175563.398220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00100000:2.0:1789175563.398227:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:2353:x1876086251161344:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175563.398239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2353:x1876086251161216:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175563.398245:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 296 00000100:00100000:2.0:1789175563.398249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+31:2353:x1876086251161344:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175563.398255:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00080000:2.0:1789175563.398270:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175563.398616:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161472 00000100:00100000:1.0:1789175563.398622:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161472 00000100:00100000:1.0:1789175563.398662:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161600 00000100:00100000:1.0:1789175563.398671:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161600 00000100:00100000:1.0:1789175563.398702:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:1.0:1789175563.398709:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251161472:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175563.398740:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+8:2353:x1876086251161472:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 32us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175563.398746:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:1.0:1789175563.398758:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:1.0:1789175563.398764:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251161600:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175563.398786:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2353:x1876086251161600:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175563.398791:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00080000:3.0:1789175563.407201:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175563.407209:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789175563.749816:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789175563.800668:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1789175563.800709:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1789175563.810213:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789175563.810248:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97e701370840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789175563.810256:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7111df800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97e7147d0a80 00000020:00080000:3.0:1789175563.810260:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97e7111df300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97e7344b1000 00000020:00080000:1.0:1789175563.810819:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1789175563.811553:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789175563.811652:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1789175564.777548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175565.801854:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175566.241820:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175566.241845:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274208256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175566.241921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175566.242055:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208256 00000100:00100000:1.0:1789175566.242064:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208256 00000100:00100000:1.0:1789175566.242146:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789175566.242157:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274208256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789175566.242192:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789175566.242242:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274208256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175566.242249:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789175566.242285:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1789175566.242291:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1789175566.242319:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274208256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789175566.242799:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789175566.498029:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789175566.498038:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789175566.498961:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789175566.498982:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789175566.538563:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175566.539555:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251161856 00000100:00100000:2.0:1789175566.539566:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251161856 00000100:00100000:2.0:1789175566.539654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:2.0:1789175566.539667:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11301:x1876086251161856:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789175566.539783:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11301:x1876086251161856:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 120us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175566.539791:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00080000:3.0:1789175566.540329:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175566.546490:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175566.546863:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162112 00000100:00100000:0.0:1789175566.546874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162112 00000100:00100000:0.0:1789175566.546943:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:0.0:1789175566.546953:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+18:11301:x1876086251162112:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789175566.547332:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:11301:x1876086251162112:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 380us (849us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789175566.547382:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:1.0:1789175566.753627:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274208768:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.753699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175566.753756:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789175566.753758:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274208512:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.753765:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274208640:0@lo:400:kworker.0 00000100:00100000:2.0:1789175566.753798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175566.753829:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789175566.753850:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274208384:0@lo:400:kworker.0 00000100:00100000:2.0:1789175566.753881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175566.753904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274208896:0@lo:400:kworker.0 00000100:00100000:2.0:1789175566.753928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175566.754074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208384 00000100:00100000:0.0:1789175566.754082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208384 00000100:00100000:1.0:1789175566.754256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208768 00000100:00100000:1.0:1789175566.754261:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208768 00000100:00100000:1.0:1789175566.754309:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208512 00000100:00100000:1.0:1789175566.754313:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208512 00000100:00100000:1.0:1789175566.754336:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789175566.754362:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274208768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274208768:12345-0@lo:400:kworker.0 Request processed in 62us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175566.754429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789175566.754445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789175566.754451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274208512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274208512:12345-0@lo:400:kworker.0 Request processed in 49us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175566.754506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789175566.754536:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175566.754578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274208768:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754601:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208640 00000100:00100000:1.0:1789175566.754604:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208640 00000100:00100000:1.0:1789175566.754626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789175566.754631:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274208640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754661:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274208640:12345-0@lo:400:kworker.0 Request processed in 30us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175566.754796:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789175566.754828:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7343e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274208640:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754858:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274208896 00000100:00100000:1.0:1789175566.754862:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274208896 00000100:00100000:1.0:1789175566.754890:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175566.754896:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274208896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.754931:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274208896:12345-0@lo:400:kworker.0 Request processed in 35us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175566.754937:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175566.754979:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789175566.754985:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789175566.755001:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e72643d180, transno 4294967310 00000100:00100000:1.0:1789175566.755011:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274208896:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.755023:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274208512:0@lo:400:kworker.0 00000100:00100000:0.0:1789175566.759942:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789175566.759980:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274208384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175566.760156:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274208384:12345-0@lo:400:kworker.0 Request processed in 199us (6270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175566.760171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789175566.760768:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274208384:0@lo:400:kworker.0 00000100:00100000:1.0:1789175566.765327:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789175566.765371:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274209024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175566.765451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175566.765722:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209024 00000100:00100000:2.0:1789175566.765737:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209024 00000100:00100000:2.0:1789175566.765824:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789175566.765840:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274209024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175566.765892:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175566.765943:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274209024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175566.765950:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789175566.768138:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274209024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789175566.771675:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175566.771946:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789175566.817519:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175566.831106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175566.831265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162240 00000100:00100000:2.0:1789175566.831276:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162240 00000100:00080000:3.0:1789175566.831333:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175566.831382:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:2.0:1789175566.831393:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e711040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:12109:x1876086251162240:12345-192.168.201.18@tcp:101:lsof.0 00010000:00010000:2.0:1789175566.831411:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175566.831432:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f3b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831743:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831758:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831770:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175566.831825:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175566.831829:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175566.831848:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831884:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f3b expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831904:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f3b expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175566.831914:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:2.0:1789175566.831917:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175566.831920:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175566.831995:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e711040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+6:12109:x1876086251162240:12345-192.168.201.18@tcp:101:lsof.0 Request processed in 604us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175566.832002:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 239 00010000:00010000:1.0:1789175567.841526:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175568.513103:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175568.513152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175568.513192:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175568.513225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175568.513269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175568.513303:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162624 00000100:00100000:1.0:1789175568.513313:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162624 00000100:00100000:1.0:1789175568.513395:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162752 00000100:00100000:1.0:1789175568.513399:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162752 00000100:00100000:3.0:1789175568.513528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162368 00000100:00100000:3.0:1789175568.513533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162368 00000100:00100000:3.0:1789175568.513563:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 298 00000100:00100000:3.0:1789175568.513573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251162368:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175568.513654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2355:x1876086251162368:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 83us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175568.513687:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 298 00000100:00080000:3.0:1789175568.513719:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175568.513723:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175568.513851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162880 00000100:00100000:0.0:1789175568.513856:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162880 00000100:00100000:0.0:1789175568.513891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251162496 00000100:00100000:0.0:1789175568.513894:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251162496 00000100:00100000:0.0:1789175568.513918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1789175568.513947:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2355:x1876086251162880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175568.513982:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2355:x1876086251162880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 51us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175568.513989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1789175568.514001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:0.0:1789175568.514007:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2355:x1876086251162496:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175568.514035:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+19:2355:x1876086251162496:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175568.514041:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00080000:0.0:1789175568.514058:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175568.514410:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1789175568.514432:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2355:x1876086251162624:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175568.514472:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2355:x1876086251162624:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 53us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175568.519088:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:3.0:1789175568.519113:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7343e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251162752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175568.519203:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7343e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2355:x1876086251162752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 101us (5933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175568.519211:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1789175568.526553:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00010000:00010000:3.0:1789175568.865982:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175568.867497:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789175568.867520:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789175568.867644:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789175568.867665:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1789175569.733703:0:12766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:12:48 (1789175568) 00010000:00010000:3.0:1789175569.899104:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175570.913447:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175571.363856:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274209152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789175571.363942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175571.364133:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209152 00000100:00100000:0.0:1789175571.364142:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209152 00000100:00100000:0.0:1789175571.364206:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789175571.364216:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274209152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175571.364250:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175571.364300:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274209152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175571.364306:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789175571.364371:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274209152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789175571.364431:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175571.873883:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274209536:0@lo:400:kworker.0 00000100:00100000:0.0:1789175571.873956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175571.874027:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175571.874034:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274209408:0@lo:400:kworker.0 00000100:00100000:0.0:1789175571.874060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175571.874109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209536 00000100:00100000:0.0:1789175571.874117:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209536 00000100:00100000:0.0:1789175571.874164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209408 00000100:00100000:0.0:1789175571.874167:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209408 00000100:00100000:0.0:1789175571.874189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789175571.874198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274209536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175571.874250:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274209536:12345-0@lo:400:kworker.0 Request processed in 53us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175571.874257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789175571.874274:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789175571.874280:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274209408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175571.874311:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274209408:12345-0@lo:400:kworker.0 Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175571.874317:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789175571.874388:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274209408:0@lo:400:kworker.0 00000100:00100000:0.0:1789175571.874400:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274209536:0@lo:400:kworker.0 00000100:00100000:3.0:1789175571.874884:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274209664:0@lo:400:kworker.0 00000100:00100000:3.0:1789175571.874920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175571.874954:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789175571.874961:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274209280:0@lo:400:kworker.0 00000100:00100000:3.0:1789175571.874990:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175571.875012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274209792:0@lo:400:kworker.0 00000100:00100000:3.0:1789175571.875037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175571.875066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209792 00000100:00100000:3.0:1789175571.875070:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209792 00000100:00100000:3.0:1789175571.875104:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789175571.875112:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175571.875151:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274209792:12345-0@lo:400:kworker.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175571.875168:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789175571.875260:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274209792:0@lo:400:kworker.0 00000100:00100000:2.0:1789175571.875459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209664 00000100:00100000:2.0:1789175571.875465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209664 00000100:00100000:2.0:1789175571.875505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789175571.875513:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274209664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175571.875554:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7077b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274209664:12345-0@lo:400:kworker.0 Request processed in 42us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175571.875560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789175571.875587:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789175571.875677:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274209920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175571.875709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789175571.875747:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789175571.875752:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175571.875762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209280 00000100:00100000:1.0:1789175571.875766:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209280 00000100:00100000:1.0:1789175571.875795:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789175571.875802:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274209280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175571.875919:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274209920 00000100:00100000:2.0:1789175571.875924:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274209920 00000100:00100000:2.0:1789175571.875950:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789175571.875956:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274209920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175571.875987:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175571.876027:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274209920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175571.876033:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789175571.876155:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274209920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175571.876207:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274209280:12345-0@lo:400:kworker.0 Request processed in 406us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175571.876215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789175571.876257:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274209280:0@lo:400:kworker.0 00010000:00010000:1.0:1789175571.940536:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175572.961688:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175573.452537:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175573.452648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251163136 00000100:00100000:2.0:1789175573.452671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251163136 00000100:00100000:2.0:1789175573.452760:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:2.0:1789175573.452774:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+18:12331:x1876086251163136:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:2.0:1789175573.453386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5b56eceb-e538-4909-8f73-c533ee4baa44+19:12331:x1876086251163136:12345-192.168.201.18@tcp:35:umount.0 Request processed in 612us (861us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789175573.453397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00080000:1.0:1789175573.453478:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175573.456666:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175573.456857:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251163392 00000100:00100000:1.0:1789175573.456871:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251163392 00000100:00100000:1.0:1789175573.456951:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:1.0:1789175573.456964:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+19:12331:x1876086251163392:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:1.0:1789175573.457537:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+20:12331:x1876086251163392:12345-192.168.201.18@tcp:35:umount.0 Request processed in 573us (882us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789175573.457546:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1789175573.469602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175573.470461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251163648 00000100:00100000:0.0:1789175573.470475:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251163648 00000100:00100000:0.0:1789175573.470551:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:0.0:1789175573.470563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70833c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+20:12331:x1876086251163648:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:0.0:1789175573.470894:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70833c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+21:12331:x1876086251163648:12345-192.168.201.18@tcp:35:umount.0 Request processed in 333us (1305us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789175573.470902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:0.0:1789175573.474906:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175573.475238:0:11956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251163904 00000100:00100000:1.0:1789175573.475252:0:11956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251163904 00000100:00100000:1.0:1789175573.475325:0:11956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1789175573.475374:0:11956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+21:12331:x1876086251163904:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:1.0:1789175573.475854:0:11956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:12331:x1876086251163904:12345-192.168.201.18@tcp:35:umount.0 Request processed in 508us (952us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789175573.475864:0:11956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:3.0:1789175573.480800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175573.480842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175573.480882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175573.480945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175573.481022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251164032 00000100:00100000:2.0:1789175573.481035:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251164032 00000100:00100000:2.0:1789175573.481120:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251164288 00000100:00100000:2.0:1789175573.481124:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251164288 00000100:00100000:2.0:1789175573.481142:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251164160 00000100:00100000:2.0:1789175573.481145:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251164160 00000100:00100000:0.0:1789175573.481167:0:8505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1789175573.481394:0:8505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b713f2ef-bd6e-4338-b8a1-2540482274c5+15:2354:x1876086251164032:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175573.481416:0:8505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175573.481441:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031800/0x1112cdeac4c16683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ac6 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175573.481465:0:8505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175573.481536:0:8505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b713f2ef-bd6e-4338-b8a1-2540482274c5+14:2354:x1876086251164032:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 149us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175573.485941:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1789175573.486468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251164416 00000100:00100000:1.0:1789175573.486482:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251164416 00000100:00100000:1.0:1789175573.486567:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:1.0:1789175573.486576:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+5:2352:x1876086251164416:12345-192.168.201.18@tcp:9:umount.0 00000020:00000080:1.0:1789175573.486623:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1695b 00000100:00080000:1.0:1789175573.486634:0:6687:0:(import.c:65:import_set_state_nolock()) ffff97e710c1a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789175573.486686:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789175573.487207:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+2:2352:x1876086251164416:12345-192.168.201.18@tcp:9:umount.0 Request processed in 629us (6259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175573.487237:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00080000:1.0:1789175573.487273:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789175573.489686:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b713f2ef-bd6e-4338-b8a1-2540482274c5+14:2354:x1876086251164288:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175573.489739:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175573.489773:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1c00/0x1112cdeac4c1686d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b91 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175573.489835:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175573.489918:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b713f2ef-bd6e-4338-b8a1-2540482274c5+13:2354:x1876086251164288:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 3958us (9073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175573.489930:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1789175573.490263:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:2.0:1789175573.490277:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:2354:x1876086251164160:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175573.490287:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175573.490298:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0e00/0x1112cdeac4c165e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2a8e expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175573.490318:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175573.490370:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2354:x1876086251164160:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 69us (9459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175573.490376:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00010000:00010000:2.0:1789175573.490448:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175573.492971:0:8505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175573.492987:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175573.493101:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251164800 00000100:00100000:3.0:1789175573.493114:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251164800 00000100:00100000:3.0:1789175573.493209:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:3.0:1789175573.493222:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+7:2352:x1876086251164800:12345-192.168.201.18@tcp:9:umount.0 00000020:00000080:3.0:1789175573.493268:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16bc3 00000020:00010000:3.0:1789175573.493278:0:6685:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97e73474b800: total 0 00000100:00080000:3.0:1789175573.493284:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e73474a800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789175573.493330:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1789175573.497623:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97e73474b800: total 0 00010000:00010000:2.0:1789175573.497725:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97e73474b800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789175573.497823:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c16f5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d66 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175573.497882:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086da7029/0x1112cdeac4c175fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f34 expref: 5 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175573.497900:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97e73474b800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789175573.497930:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175573.497933:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175573.497934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789175573.500613:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789175573.501052:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b56eceb-e538-4909-8f73-c533ee4baa44+2:2352:x1876086251164800:12345-192.168.201.18@tcp:9:umount.0 Request processed in 7824us (8068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175573.501069:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:1.0:1789175573.509726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175573.509911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251165824 00000100:00100000:0.0:1789175573.509926:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251165824 00000100:00100000:0.0:1789175573.510127:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:0.0:1789175573.510141:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+22:2352:x1876086251165824:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:0.0:1789175573.510189:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165f7 00000020:00010000:0.0:1789175573.510212:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97e73be0e000: total 0 00000100:00080000:0.0:1789175573.510218:0:5840:0:(import.c:65:import_set_state_nolock()) ffff97e73be0a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789175573.510289:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789175573.510760:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b56eceb-e538-4909-8f73-c533ee4baa44+21:2352:x1876086251165824:12345-192.168.201.18@tcp:39:umount.0 Request processed in 619us (1046us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789175573.510838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 240 00000020:00010000:1.0:1789175573.512467:0:6701:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97e73be0e000: total 0 00010000:00010000:1.0:1789175573.512539:0:6701:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97e73be0e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789175573.512587:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175573.512592:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789175573.512605:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c16931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2bbb expref: 20 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512629:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175573.512632:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175573.512637:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031e00/0x1112cdeac4c174de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ee7 expref: 19 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512653:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175573.512656:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789175573.512660:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705669600/0x1112cdeac4c16fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d89 expref: 18 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512674:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175573.512677:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175573.512698:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f8c00/0x1112cdeac4c16e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d19 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512715:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e721b55800) 00010000:00010000:1.0:1789175573.512717:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789175573.512720:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a400/0x1112cdeac4c168dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2ba6 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512742:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175573.512744:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175573.512747:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c16f20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d51 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512758:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175573.512761:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789175573.512764:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668000/0x1112cdeac4c175be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f1f expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512862:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:1.0:1789175573.512865:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175573.512871:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a000/0x1112cdeac4c16fc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d82 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512885:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97e7181cdc00) 00010000:00010000:1.0:1789175573.512888:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789175573.512892:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c16c1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2c8d expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512908:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7181cd500) 00010000:00010000:1.0:1789175573.512917:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789175573.512922:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7013a1a00/0x1112cdeac4c168c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b9f expref: 11 pid: 8054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.512942:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97e7051dbc00) 00010000:00010000:1.0:1789175573.512945:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789175573.512949:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e7050f9600/0x1112cdeac4c16f4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2d5f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.513031:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97e7102ec200) 00010000:00010000:1.0:1789175573.513034:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789175573.513040:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654a200/0x1112cdeac4c172bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2e5b expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.513242:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97e7102ec300) 00010000:00010000:1.0:1789175573.513245:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789175573.513254:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e705668c00/0x1112cdeac4c175e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f2d expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175573.513268:0:6701:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97e73be0e000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789175573.513284:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175573.513286:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175573.513289:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175573.631622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175573.631823:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251165952 00000100:00100000:0.0:1789175573.631837:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251165952 00000100:00100000:0.0:1789175573.631949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:0.0:1789175573.631973:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2354:x1876086251165952:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175573.632087:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2354:x1876086251165952:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 127us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175573.632113:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00080000:1.0:1789175573.632708:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789175573.982167:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175573.982180:0:6713:0:(genops.c:885:class_export_put()) final put ffff97e73474b800/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175573.982219:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73474b800/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-OST0000 00000020:00000080:2.0:1789175573.982278:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73474a800 for lustre-OST0000 00010000:00010000:3.0:1789175573.986381:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789175573.991888:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000001:00080000:1.0:1789175573.991913:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789175573.991935:0:5860:0:(genops.c:885:class_export_put()) final put ffff97e73be0e000/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:2.0:1789175573.992076:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73be0e000/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-MDT0000 00000020:00000080:2.0:1789175573.992171:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73be0a000 for lustre-MDT0000 00000100:00100000:2.0:1789175574.947452:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175574.947498:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175574.947595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175574.947743:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166080 00000100:00100000:2.0:1789175574.947762:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166080 00000100:00100000:2.0:1789175574.947838:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166336 00000100:00100000:2.0:1789175574.947842:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166336 00000100:00100000:2.0:1789175574.947857:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166208 00000100:00100000:2.0:1789175574.947860:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166208 00000100:00100000:2.0:1789175574.947879:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1789175574.947891:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+12:2356:x1876086251166080:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175574.947910:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175574.947936:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f8600/0x1112cdeac4c166c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2adb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175574.947958:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175574.948095:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+11:2356:x1876086251166080:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 205us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175574.948103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1789175574.948147:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1789175574.948153:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+10:2356:x1876086251166336:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175574.948161:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175574.948172:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654b400/0x1112cdeac4c16866 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b8a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175574.948182:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175574.948201:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+9:2356:x1876086251166336:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 49us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175574.948207:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1789175574.948221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175574.948227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+8:2355:x1876086251166208:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175574.948235:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175574.948243:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654a800/0x1112cdeac4c166d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2b05 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175574.948252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175574.948269:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b713f2ef-bd6e-4338-b8a1-2540482274c5+7:2355:x1876086251166208:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 43us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175574.948276:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175574.962239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175574.962403:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166592 00000100:00100000:0.0:1789175574.962417:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166592 00000100:00100000:0.0:1789175574.962505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 241 00000100:00100000:0.0:1789175574.962517:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+6:2352:x1876086251166592:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:0.0:1789175574.962573:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c166de 00000020:00010000:0.0:1789175574.962585:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97e73465a800: total 0 00000100:00080000:0.0:1789175574.962590:0:5840:0:(import.c:65:import_set_state_nolock()) ffff97e73465d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789175574.962912:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789175574.963513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15bde859-e823-4861-b8b2-68ba9f4f9050+5:2352:x1876086251166592:12345-192.168.201.18@tcp:39:umount.0 Request processed in 994us (1284us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789175574.963525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 241 00000020:00010000:3.0:1789175574.965501:0:6702:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97e73465a800: total 0 00010000:00010000:3.0:1789175574.965577:0:6702:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97e73465a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789175574.965694:0:6702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e721b55400) 00010000:00010000:3.0:1789175574.965699:0:6702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789175574.965713:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c1760b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f3b expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175574.965745:0:6702:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97e73465a800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789175574.965831:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175574.965833:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175574.965856:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175575.004938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175575.005085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166848 00000100:00100000:3.0:1789175575.005099:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166848 00000100:00100000:3.0:1789175575.005166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 300 00000100:00100000:3.0:1789175575.005178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+7:2352:x1876086251166848:12345-192.168.201.18@tcp:251:umount.0 00000020:00000080:3.0:1789175575.005250:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165d4 00000020:00010000:3.0:1789175575.005260:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97e734452800: total 0 00000100:00080000:3.0:1789175575.005266:0:5832:0:(import.c:65:import_set_state_nolock()) ffff97e734453800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789175575.005383:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b713f2ef-bd6e-4338-b8a1-2540482274c5+3:2352:x1876086251166848:12345-192.168.201.18@tcp:251:umount.0 Request processed in 206us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175575.005392:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 300 00000020:00010000:1.0:1789175575.006103:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97e734452800: total 0 00010000:00010000:1.0:1789175575.006111:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175575.006187:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97e734452800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789175575.006235:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700030600/0x1112cdeac4c1668a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2acd expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175575.006256:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97e734452800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789175575.006267:0:5827:0:(genops.c:885:class_export_put()) final put ffff97e734452800/b713f2ef-bd6e-4338-b8a1-2540482274c5 00010000:00010000:1.0:1789175575.006292:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175575.006294:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175575.006296:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789175575.006930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734452800/b713f2ef-bd6e-4338-b8a1-2540482274c5 for MGS 00000020:00000080:3.0:1789175575.006992:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e734453800 for MGS 00010000:00010000:1.0:1789175575.010509:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175576.036496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175576.482030:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274210048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175576.482128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.482280:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210048 00000100:00100000:3.0:1789175576.482292:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210048 00000100:00100000:3.0:1789175576.482413:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789175576.482425:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274210048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175576.482475:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789175576.482679:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789175576.483134:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274210048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 709us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175576.483143:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789175576.483326:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274210048:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789175576.738710:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789175576.738735:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789175576.740854:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789175576.740872:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789175576.993701:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274210304:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.993870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.994085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789175576.994092:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274210176:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.994126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.994151:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274210688:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.994191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.994219:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274210560:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.994415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.994437:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175576.994442:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e734438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274210432:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.994464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175576.994493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210304 00000100:00100000:3.0:1789175576.994502:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210304 00000100:00100000:3.0:1789175576.994556:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210560 00000100:00100000:3.0:1789175576.994559:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210560 00000100:00100000:3.0:1789175576.994579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210432 00000100:00100000:3.0:1789175576.994582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210432 00000100:00100000:3.0:1789175576.994599:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789175576.994608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274210304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.994668:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274210304:12345-0@lo:400:kworker.0 Request processed in 59us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175576.994675:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789175576.994692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789175576.994698:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175576.995211:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789175576.995223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274210432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.995373:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876086274210560:12345-0@lo:400:kworker.0 Request processed in 674us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175576.995382:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789175576.995411:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210176 00000100:00100000:3.0:1789175576.995417:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210176 00000100:00100000:3.0:1789175576.995448:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789175576.995456:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.995490:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3307:x1876086274210176:12345-0@lo:400:kworker.0 Request processed in 36us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175576.995509:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789175576.995691:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274210432:12345-0@lo:400:kworker.0 Request processed in 471us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175576.995698:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789175576.996101:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210688 00000100:00100000:1.0:1789175576.996108:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210688 00000100:00100000:1.0:1789175576.996154:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789175576.996162:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73bad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274210688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175576.996206:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73bad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274210688:12345-0@lo:400:kworker.0 Request processed in 46us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175576.996213:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789175576.996323:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789175576.996328:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175576.996405:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e7075ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274210816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175576.996465:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175576.996518:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3307:1876086274210176:0@lo:400:kworker.0 00000100:00100000:2.0:1789175576.996534:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274210688:0@lo:400:kworker.0 00000100:00100000:2.0:1789175576.996547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274210304:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.998326:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e734438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274210432:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.998366:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1876086274210560:0@lo:400:kworker.0 00000100:00100000:3.0:1789175576.998426:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210816 00000100:00100000:3.0:1789175576.998433:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210816 00000100:00100000:3.0:1789175576.998477:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789175576.998486:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274210816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175576.998529:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175576.998598:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274210816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175576.998605:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789175576.999014:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e7075ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274210816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789175577.057933:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789175577.155748:0:12964:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789175577.167690:0:12964:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789175577.167755:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.167774:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.167793:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.167801:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.167847:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789175577.167854:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789175577.167884:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789175577.167890:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789175577.167897:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789175577.167939:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e70f954800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789175577.168398:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175577.168409:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.168418:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ae00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175577.168422:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.168432:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175577.168440:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175577.168455:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789175577.168458:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789175577.168461:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789175577.168499:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.168506:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175577.168533:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.168540:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c16659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16660 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.168555:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175577.168556:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175577.168558:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175577.168579:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274210944:0@lo:39:umount.0 00000100:00100000:2.0:1789175577.168687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175577.168778:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175577.168796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175577.168835:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175577.168876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274210944 00000100:00100000:2.0:1789175577.168884:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274210944 00000100:00100000:2.0:1789175577.168951:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789175577.168964:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876086274210944:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789175577.168999:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c163ea 00000100:00080000:2.0:1789175577.169011:0:5838:0:(import.c:65:import_set_state_nolock()) ffff97e72644d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789175577.169100:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1876086274210944:12345-0@lo:39:umount.0 Request processed in 139us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175577.169115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1789175577.169127:0:5838:0:(genops.c:885:class_export_put()) final put ffff97e72644a000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1789175577.169158:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211072 00000100:00100000:2.0:1789175577.169162:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211072 00000100:00100000:2.0:1789175577.169194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789175577.169201:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e707446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3305:x1876086274211072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175577.169214:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175577.169232:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654b800/0x1112cdeac4c16660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16659 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.169246:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789175577.169263:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e70f954800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789175577.169273:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e707446050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3305:x1876086274211072:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175577.169274:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274210944:0@lo:39:umount.0 00000100:00100000:2.0:1789175577.169279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789175577.169301:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789175577.169304:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789175577.169309:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789175577.169325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e72644a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789175577.169394:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e72644d800 for lustre-MDT0000 00000100:00100000:2.0:1789175577.169418:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175577.170325:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175577.171650:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171671:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171678:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171685:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171717:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175577.171724:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171755:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171771:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171777:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171797:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175577.171804:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171811:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171817:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171822:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171832:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789175577.171836:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171842:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171857:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171864:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175577.171887:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789175577.171891:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789175577.171937:0:12964:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789175577.171942:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1789175577.171948:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1789175577.171948:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789175577.171954:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00010000:00010000:2.0:1789175577.171957:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789175577.171962:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97e737dd9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789175577.171964:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a0000 already unused, calling callback (ffffffffc1ccec20) 00000020:00080000:0.0:1789175577.171968:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff97e737ddf800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1789175577.171969:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789175577.171977:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff97e73465a800 15bde859-e823-4861-b8b2-68ba9f4f9050 192.168.201.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789175577.171980:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789175577.171983:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff97e73c3a4d40) has exports, disconnecting them 00000020:00080000:0.0:1789175577.171988:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97e737dd9800), last request at 1789175576 10000000:00010000:2.0:1789175577.171996:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789175577.171997:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16556 10000000:01000000:2.0:1789175577.172002:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789175577.172005:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789175577.172007:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:0.0:1789175577.172018:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e737dd9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789175577.172053:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172060:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789175577.172076:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e737dd9800): rc 0 00000020:00000080:0.0:1789175577.172079:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e737dd9800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1789175577.172087:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789175577.172091:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97e737ddf800), last request at 1789175576 00000020:00000080:0.0:1789175577.172094:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1648b 00010000:00010000:2.0:1789175577.172096:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a0000/0x1112cdeac4c16667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c1666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789175577.172100:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e737dde800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789175577.172107:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e737ddf800): rc 0 00000020:00000080:0.0:1789175577.172109:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e737ddf800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1789175577.172111:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789175577.172114:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1789175577.172118:0:12964:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb14d817f7ae0 00010000:00010000:2.0:1789175577.172119:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7013a1600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175577.172122:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172128:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175577.172134:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175577.172146:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:0.0:1789175577.172147:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 10000000:01000000:2.0:1789175577.172148:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789175577.172150:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:0.0:1789175577.172151:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00010000:00010000:2.0:1789175577.172162:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175577.172166:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789175577.172168:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175577.172181:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172187:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7013a1600/0x1112cdeac4c1658e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16595 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172203:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789175577.172206:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172211:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175577.172214:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172221:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175577.172228:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175577.172233:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789175577.172234:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00080000:0.0:1789175577.172234:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:01000000:2.0:1789175577.172236:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1789175577.172247:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e7267e7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789175577.172252:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172257:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1789175577.172259:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789175577.172261:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1789175577.172263:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172269:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7050f9e00/0x1112cdeac4c16890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16897 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175577.172270:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789175577.172277:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175577.172280:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172286:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e701527200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1789175577.172288:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172295:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789175577.172302:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175577.172307:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789175577.172309:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789175577.172311:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789175577.172321:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172326:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789175577.172331:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175577.172364:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701527200/0x1112cdeac4c16342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175577.172373:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274211456:0@lo:9:umount.0 00010000:00010000:2.0:1789175577.172391:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175577.172392:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175577.172394:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175577.172401:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175577.172411:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274211712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175577.172456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789175577.172682:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175577.176440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789175577.176562:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789175577.176599:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e734454800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789175577.176649:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274211840:0@lo:9:umount.0 00000100:00100000:0.0:1789175577.176729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789175577.176822:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97e73c3a4d40) has no exports 00000100:00100000:1.0:1789175577.177145:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211456 00000100:00100000:1.0:1789175577.177159:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211456 00000100:00100000:1.0:1789175577.177218:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211840 00000100:00100000:1.0:1789175577.177221:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211840 00000100:00100000:1.0:1789175577.177244:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789175577.177255:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876086274211456:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789175577.177288:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c164e6 00000100:00080000:1.0:1789175577.177299:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e7267e2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789175577.177369:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789175577.177456:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274211328:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789175577.177521:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e737dd9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789175577.178140:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1876086274211456:12345-0@lo:9:umount.0 Request processed in 883us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175577.178149:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789175577.178172:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789175577.178181:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876086274211840:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789175577.178202:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165bf 00000100:00080000:1.0:1789175577.178211:0:6685:0:(import.c:65:import_set_state_nolock()) ffff97e734452000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789175577.178241:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789175577.178337:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1876086274211840:12345-0@lo:9:umount.0 Request processed in 159us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175577.178415:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1789175577.178442:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175577.178449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789175577.179206:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e737ddf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789175577.179256:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e737dd9000 for lustre-MDT0000 00000020:00000080:3.0:1789175577.179262:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e737dde800 for lustre-MDT0000 00000100:00100000:3.0:1789175577.179464:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175577.179532:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175577.179594:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211712 00000100:00100000:3.0:1789175577.179603:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211712 00000100:00100000:3.0:1789175577.179673:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175577.179682:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3304:x1876086274211712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175577.179698:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789175577.180280:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175577.180331:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175577.180358:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274211584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175577.180397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175577.180429:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211328 00000100:00100000:2.0:1789175577.180435:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211328 00000100:00100000:2.0:1789175577.180460:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211584 00000100:00100000:2.0:1789175577.180463:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211584 00000100:00100000:1.0:1789175577.180468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789175577.180478:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+20:3306:x1876086274211328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175577.180485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789175577.180492:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789175577.180511:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1789175577.180516:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e701527000/0x1112cdeac4c16595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c1658e expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175577.180520:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1789175577.180540:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175577.180582:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274211328:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175577.180589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789175577.180606:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274211200 00000100:00100000:1.0:1789175577.180609:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274211200 00000100:00100000:1.0:1789175577.180626:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789175577.180632:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+19:3306:x1876086274211584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175577.180639:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175577.180662:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9200/0x1112cdeac4c16897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16890 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175577.180671:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175577.180694:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+18:3306:x1876086274211584:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175577.180700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789175577.180713:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789175577.180719:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+17:3305:x1876086274211200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175577.180727:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175577.180736:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654a600/0x1112cdeac4c1666e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16667 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175577.180744:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175577.180778:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+16:3305:x1876086274211200:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175577.181706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789175577.181867:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e7267e7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789175577.181884:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e74205e000/0x1112cdeac4c16349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16342 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175577.181916:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175577.181963:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274211584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175577.181975:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3306:1876086274211328:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1789175577.183277:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789175577.183288:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789175577.183298:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274211456:0@lo:9:umount.0 00000100:00080000:0.0:1789175577.183378:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e734454800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789175577.183384:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789175577.183386:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789175577.183388:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274211840:0@lo:9:umount.0 00000100:00100000:2.0:1789175577.184279:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175577.190613:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e50b439a-f3a6-4419-9d6a-3b18255dcdb8+14:3304:x1876086274211712:12345-0@lo:103:ldlm_bl.0 Request processed in 10919us (18143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175577.190623:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3304:1876086274211712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175577.190775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:1.0:1789175577.203405:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff97e73c3a4d40) has no exports 00000020:00000080:1.0:1789175577.290559:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1639d 00000020:00000080:1.0:1789175577.290572:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e734c73000/lustre-QMT0000_UUID 00000020:01000000:1.0:1789175577.290623:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789175577.290688:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789175577.290700:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789175577.290705:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff97e73c3a19c0) has no exports 00000020:00000080:0.0:1789175577.292286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734c73000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789175577.294263:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16396 00000020:00000080:0.0:1789175577.294282:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7208e5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789175577.294433:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175577.294449:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789175577.294453:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7208e4800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789175577.294456:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7208e4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789175577.294464:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789175577.294944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7208e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:1.0:1789175577.661748:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789175577.661762:0:7644:0:(genops.c:885:class_export_put()) final put ffff97e734450000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789175577.661830:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:1.0:1789175577.661833:0:7644:0:(genops.c:885:class_export_put()) final put ffff97e710c1c000/5b56eceb-e538-4909-8f73-c533ee4baa44 00000020:00000080:0.0:1789175577.663006:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734450000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789175577.663071:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e710c1c000/5b56eceb-e538-4909-8f73-c533ee4baa44 for lustre-OST0001 00000020:00000080:0.0:1789175577.663090:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e734452000 for lustre-OST0001 00000020:00000080:0.0:1789175577.663095:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e710c1a000 for lustre-OST0001 00010000:00010000:1.0:1789175578.081576:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789175579.102566:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15bde859-e823-4861-b8b2-68ba9f4f9050 00000001:00080000:3.0:1789175579.102591:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789175579.102598:0:5860:0:(genops.c:885:class_export_put()) final put ffff97e73465a800/15bde859-e823-4861-b8b2-68ba9f4f9050 00000020:00000080:3.0:1789175579.102632:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73465a800/15bde859-e823-4861-b8b2-68ba9f4f9050 for lustre-MDT0000 00000020:00000080:3.0:1789175579.102711:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73465d800 for lustre-MDT0000 00010000:00010000:1.0:1789175579.105442:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789175579.108684:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789175579.108697:0:6713:0:(genops.c:885:class_export_put()) final put ffff97e7267e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789175579.108812:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7267e3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789175579.108887:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e7267e2800 for lustre-OST0000 00000020:01000000:0.0:1789175579.297658:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e707603720 - data ffff97e73fe0ca20/ffff97e72e2f0c00 00000020:01000000:0.0:1789175579.297844:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e7208fc0c0 - data ffff97e71dc8c000/ffff97e73401f000 00000001:00000004:0.0:1789175579.314702:0:12964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1789175579.422848:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789175579.422860:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789175579.422896:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789175579.422899:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789175579.423485:0:6832:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789175579.423491:0:6832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789175579.423503:0:6832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789175579.424679:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789175579.424686:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789175579.424707:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789175579.424711:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789175579.429494:0:8052:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789175579.429504:0:8052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789175579.429528:0:8052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789175579.520401:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16365 00000020:00000080:3.0:1789175579.520418:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789175579.521091:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789175579.523662:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1637a 00000020:00000080:3.0:1789175579.523682:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789175579.523751:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789175579.523764:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.523777:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789175579.523782:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff97e73c3a0000) has no exports 00000004:01000000:3.0:1789175579.524071:0:12964:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789175579.524082:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165b8 00000020:00000080:3.0:1789175579.524088:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73bbaa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789175579.524698:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789175579.524969:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789175579.524987:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.524999:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789175579.525003:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff97e73be2b380) has no exports 00000020:00000080:3.0:1789175579.525015:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c165b1 00000020:00000080:3.0:1789175579.525022:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e734455000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789175579.525473:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789175579.525479:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789175579.525485:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789175579.525492:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789175579.525496:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789175579.525545:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.525553:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789175579.525560:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c164d1 00000020:00000080:3.0:1789175579.525566:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7267e5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789175579.525571:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789175579.525576:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.525580:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789175579.525582:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff97e7076d99c0) has no exports 00000020:00000080:3.0:1789175579.525586:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c164ca 00000020:00000080:3.0:1789175579.525589:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7267e6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789175579.526097:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73bbaa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789175579.526110:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734455000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789175579.526116:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e734454800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789175579.526124:0:496:0:(genops.c:885:class_export_put()) final put ffff97e73bbac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789175579.526126:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73bbac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789175579.526131:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789175579.526216:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7267e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789175579.526221:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7267e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789175579.526563:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789175579.526568:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789175579.526571:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789175579.526578:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789175579.526580:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789175579.526656:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.526664:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789175579.526700:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.526703:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789175579.526707:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e707180000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789175579.526709:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e707180000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789175579.526727:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789175579.526923:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16381 00000020:00000080:3.0:1789175579.526931:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b0000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789175579.527724:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e7267e7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789175579.527735:0:496:0:(genops.c:885:class_export_put()) final put ffff97e708298000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789175579.527746:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e708298000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789175579.527753:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789175579.528080:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789175579.528131:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789175579.528138:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.528146:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789175579.528150:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff97e73c3a3380) has no exports 00000020:00000080:3.0:1789175579.528180:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.528186:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789175579.528189:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b3000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789175579.528191:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789175579.528195:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789175579.528529:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16388 00000020:00000080:3.0:1789175579.528537:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b6000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789175579.528558:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7201da000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789175579.528562:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7201da000 3 00000020:01000004:3.0:1789175579.528566:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97e7201da000 from lustre-MDT0000 00000020:00000080:3.0:1789175579.528587:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.528592:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789175579.528594:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e73c3b6800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789175579.528597:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789175579.528605:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789175579.528630:0:12964:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789175579.528635:0:12964:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789175579.528638:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789175579.528641:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.528644:0:12964:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789175579.528651:0:12964:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff97e72219b000 e50b439a-f3a6-4419-9d6a-3b18255dcdb8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789175579.528658:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff97e7076d8000) has exports, disconnecting them 00000020:00080000:3.0:1789175579.528663:0:12964:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97e72219b000), last request at 1789175354 00000020:00000080:3.0:1789175579.528682:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16326 00000020:00010000:3.0:1789175579.528694:0:12964:0:(genops.c:1921:obd_stale_export_put()) Put export ffff97e72219b000: total 1 00000100:00080000:3.0:1789175579.528699:0:12964:0:(import.c:65:import_set_state_nolock()) ffff97e722198800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789175579.528760:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e72219b000): rc 0 00000020:00080000:3.0:1789175579.528766:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff97e7076d8000) has no exports 00000100:00100000:3.0:1789175579.528842:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97e7070af200:5830] 0 exiting: rc = 1 00000020:00000080:0.0:1789175579.528946:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c3b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789175579.529192:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97e70567f600:5832] 1 exiting: rc = 0 00000020:00010000:1.0:1789175579.529285:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff97e72219b000: total 0 00010000:00010000:1.0:1789175579.529324:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97e72219b000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789175579.529441:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9400/0x1112cdeac4c16628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16621 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529459:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031a00/0x1112cdeac4c16636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c1662f expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529472:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a1400/0x1112cdeac4c16644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c1663d expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529483:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c16652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c1664b expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700030e00/0x1112cdeac4c1667c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16675 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529510:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654b000/0x1112cdeac4c1687b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16874 expref: 4 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529537:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7013a0c00/0x1112cdeac4c16889 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16882 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529552:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e700031400/0x1112cdeac4c1643e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1112cdeac4c16437 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175579.529564:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97e72219b000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789175579.529578:0:5826:0:(genops.c:885:class_export_put()) final put ffff97e72219b000/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 00010000:00010000:1.0:1789175579.529628:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175579.529631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175579.529632:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175579.529731:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97e72660d000:5833] 2 exiting: rc = 0 00000020:00000080:0.0:1789175579.530264:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff97e72219b000/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 for MGS 00000020:00000080:0.0:1789175579.530307:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e722198800 for MGS 00000100:00100000:3.0:1789175579.530509:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530519:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530526:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530533:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530541:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530547:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530553:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530560:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530568:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530574:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530581:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530587:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530593:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530599:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530605:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530612:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530618:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530625:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530632:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530638:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530644:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530651:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530657:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530663:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530671:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530678:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530684:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530690:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530709:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530715:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530721:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530728:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530734:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530752:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530758:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530765:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530770:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530776:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530781:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530787:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530792:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530798:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530803:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530809:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530815:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530820:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530826:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530831:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530837:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530843:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530848:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530854:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530931:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530940:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530947:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530953:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530959:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.530965:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531154:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531164:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531170:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531176:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531182:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.531196:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789175579.531852:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789175579.531857:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1789175579.533694:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e603a66de0 - data ffff97e73febc0d8/ffff97e734cc8400 00000020:01000000:3.0:1789175579.533870:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e7116cb780 - data ffff97e71dc72d80/ffff97e707018800 00000020:00000080:3.0:1789175579.534468:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1630a 00000020:00000080:3.0:1789175579.534478:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7076d5000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789175579.534617:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7201da000 from MGS, refs=2 00000020:01000004:3.0:1789175579.534622:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7201da000 2 00000020:01000004:3.0:1789175579.534626:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97e7201da000 from MGS 00000020:00000080:3.0:1789175579.534658:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.534667:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789175579.534669:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7076d4000/MGS 00000020:00000080:3.0:1789175579.534673:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7076d4000/MGS for MGS 00000020:01000000:3.0:1789175579.534680:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789175579.534762:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789175579.534767:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.534774:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789175579.534784:0:12964:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97e707505000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789175579.534790:0:12964:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff97e707078000) has exports, disconnecting them 00000020:00080000:3.0:1789175579.534797:0:12964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97e707505000), last request at 1789175355 00000020:00000080:3.0:1789175579.534802:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c163d5 00000020:00080000:3.0:1789175579.534813:0:12964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e707505000): rc 0 00000020:00000080:3.0:1789175579.534819:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e707505000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789175579.536249:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7076d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789175579.536278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e707505000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789175579.562441:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789175579.562455:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789175579.562462:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789175579.562472:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789175579.562711:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.562723:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789175579.562734:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7201da000 1 00000020:00000080:3.0:1789175579.562770:0:12964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c162fc 00000020:00000080:3.0:1789175579.562782:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e7076d7000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789175579.562789:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789175579.562794:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.562800:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789175579.562804:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff97e7266719c0) has no exports 00000020:00000080:1.0:1789175579.562893:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e70f954800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789175579.562902:0:36:0:(genops.c:885:class_export_put()) final put ffff97e70f956800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789175579.562905:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e70f956800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789175579.562920:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789175579.562996:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7076d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789175579.610965:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789175579.610988:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789175579.610996:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e706136000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789175579.611003:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e706136000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789175579.611012:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789175579.611170:0:12964:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97e7201d8800 00000020:01000000:3.0:1789175579.611198:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789175579.611203:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175579.611208:0:12964:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789175579.611214:0:12964:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff97e7076dcd40) has no exports 00000100:00100000:1.0:1789175579.612989:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97e709778600:5840] 2 exiting: rc = 0 00000100:00100000:2.0:1789175579.613732:0:8054:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97e7050a4400:8054] 3 exiting: rc = 0 00000100:00100000:2.0:1789175579.613833:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97e70706f200:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1789175579.614767:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97e70706ee00:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1789175579.614974:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.614984:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.614992:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.614999:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615005:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615012:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615018:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615024:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615030:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615036:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615043:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615049:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615056:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615063:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615069:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615075:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615081:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615087:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615106:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615113:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615120:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615126:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615133:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615139:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615146:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615157:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615163:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615169:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615175:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615180:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615188:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615194:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615199:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615205:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615224:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615231:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615237:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615244:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615251:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615257:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615263:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615270:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615276:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615286:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615291:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615299:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615305:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615310:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615315:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615321:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615326:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615332:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615337:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615376:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615381:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615386:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615391:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615397:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615406:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615411:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615416:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615421:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615427:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.615439:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.628726:0:11956:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff97e7070a4c00:11956] 2 exiting: rc = 0 00000100:00100000:3.0:1789175579.628981:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97e707060a00:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1789175579.629094:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97e7283df400:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1789175579.629332:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629445:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629453:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629461:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629468:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629475:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629481:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629487:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629494:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629501:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629506:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629513:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629520:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629647:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629655:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629660:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629666:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629672:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629678:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629684:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629690:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629695:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629701:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629726:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629731:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629746:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629753:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629759:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629765:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629770:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629776:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629782:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629788:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629793:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629798:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629803:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629808:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629814:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629819:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629824:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629829:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629833:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629839:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629844:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629848:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629853:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629923:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629931:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629937:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629942:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629947:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629952:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629957:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629961:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629966:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629970:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629976:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629982:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.629994:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.630000:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.630005:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.630010:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.630015:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.630020:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789175579.631153:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97e7283df800:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1789175579.631493:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97e7283de800:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1789175579.631755:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631764:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631781:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631791:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631800:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631810:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631817:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631824:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631832:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631839:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631847:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631938:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631948:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631958:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631966:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631974:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631984:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631992:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.631999:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632007:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632014:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632022:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632030:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632053:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632062:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632068:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632076:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632084:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632090:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632113:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632120:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632127:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632135:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632142:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632151:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632173:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632183:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632191:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632199:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632207:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632216:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632319:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632330:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632337:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632447:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632455:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632462:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632488:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632498:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632506:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632513:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632638:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632648:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632658:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632671:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632679:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632686:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632693:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632700:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632726:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632735:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632756:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632764:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.632772:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789175579.647174:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97e7283de400:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789175579.648076:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97e7283df000:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789175579.648244:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648254:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648259:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648265:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648271:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648277:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648284:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648289:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648295:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648301:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648307:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648312:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648317:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648323:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648329:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648334:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648363:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648369:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648375:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648379:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648385:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648390:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648396:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648401:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648407:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648412:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648418:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648423:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648428:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648453:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648459:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648465:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648470:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648476:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648483:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648489:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648494:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648499:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648504:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648510:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648515:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648529:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648535:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648540:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648545:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648551:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648556:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648561:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648566:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648572:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648578:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648584:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648589:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648595:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648600:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648606:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648611:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648616:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648622:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648626:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648631:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648637:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648642:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.648647:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789175579.649479:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97e7283de200:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789175579.649735:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97e7283dfa00:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1789175579.650671:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650746:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650754:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650760:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650767:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650774:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650780:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650786:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650792:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650797:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650803:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650809:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650814:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650819:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650824:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650830:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650835:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650840:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650845:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650851:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650856:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650862:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650868:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650873:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650878:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650883:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650889:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650894:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650900:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650905:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650911:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650916:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650921:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650925:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650931:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650950:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650956:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650962:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650968:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650974:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650979:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650985:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650991:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.650997:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651002:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651007:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651013:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651018:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651023:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651028:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651034:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651039:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651045:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651050:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651055:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651060:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651065:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651070:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651075:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651081:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651086:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651091:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651096:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.651101:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789175579.654936:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97e726558000:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789175579.658666:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff97e726559600:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1789175579.659330:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659353:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659361:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659366:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659372:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659378:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659404:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659410:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659417:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659422:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659428:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659433:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659439:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659444:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659450:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659455:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659461:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659466:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659471:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659477:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659487:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659616:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659627:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659632:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659637:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659643:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659648:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659654:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659660:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659666:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659672:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659678:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659683:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659698:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659705:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659710:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659716:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659722:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659728:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659733:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659747:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659759:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659765:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659771:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659776:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659782:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659787:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659793:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659798:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659803:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659809:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659814:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659820:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659826:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659832:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659838:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659843:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659854:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659860:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659866:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659871:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659876:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659882:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.659888:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175579.660562:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff97e72db09200:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789175579.660982:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97e72db1ae00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789175579.661176:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97e72db1aa00:5853] 2 exiting: rc = 0 00000100:00100000:0.0:1789175579.663879:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663894:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663902:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663909:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663916:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663923:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663929:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663936:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663945:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663957:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663964:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.663970:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664006:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664013:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664020:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664028:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664048:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664055:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664062:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664069:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664074:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664080:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664087:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664094:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664100:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664107:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664114:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664121:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664128:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664135:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664142:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664148:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664156:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664161:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664168:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664174:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664179:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664186:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664192:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664198:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664227:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664235:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664242:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664248:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664255:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664262:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664269:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664285:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664293:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664299:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664306:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664313:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664319:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664646:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664659:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664666:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664673:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664751:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664759:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664765:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664771:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664777:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664783:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175579.664789:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789175579.676838:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789175579.676930:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789175579.676939:0:12964:0:(genops.c:885:class_export_put()) final put ffff97e707180800/MDS_uuid 00000020:00000080:1.0:1789175579.676945:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff97e707180800/MDS_uuid for MDS 00000020:01000000:1.0:1789175579.676952:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789175579.677114:0:12964:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789175580.134227:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175581.156797:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175582.114401:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274212224:0@lo:400:kworker.0 00000400:00000100:1.0:1789175582.114496:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274212224 offset 0 length 224: 4 00000100:00100000:1.0:1789175582.114568:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789175582.114574:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274212096:0@lo:400:kworker.0 00000400:00000100:1.0:1789175582.114595:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274212096 offset 0 length 224: 4 00000100:00100000:2.0:1789175582.114958:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211968:0@lo:400:kworker.0 00000400:00000100:2.0:1789175582.114982:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086274211968 offset 0 length 224: 4 00010000:00010000:1.0:1789175582.178792:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789175582.968410:0:13119:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789175582.995494:0:13119:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789175582.995570:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175582.995591:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175582.995600:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175582.995610:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175582.995634:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789175582.995641:0:13119:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789175582.995671:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789175582.995714:0:13119:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3cd180 x1876086274212096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175582.995744:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789175582.995753:0:13119:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789175582.995787:0:13119:0:(import.c:65:import_set_state_nolock()) ffff97e73fcaf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789175582.996082:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175582.996092:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175582.996101:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175582.996105:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175582.996739:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175582.996748:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175582.996755:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789175582.996758:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789175582.996761:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1789175582.996974:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274212096:0@lo:400:kworker.0 00010000:00010000:1.0:1789175582.997927:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175582.997940:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789175582.998936:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175582.998949:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e700030800/0x1112cdeac4c1663d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1112cdeac4c16644 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175582.998970:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175582.998973:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175582.998976:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175582.999007:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175582.999033:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274212480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175583.000047:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274212352:0@lo:39:umount.0 00000400:00000100:0.0:1789175583.000096:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274212352 offset 0 length 224: 4 00000100:00100000:1.0:1789175583.000963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175583.005861:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274212480 00000100:00100000:2.0:1789175583.005883:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274212480 00000100:00100000:2.0:1789175583.006021:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789175583.006033:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1876086274212480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789175583.006043:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789175583 with bad export cookie 1230272056432616230 00000100:00100000:3.0:1789175583.035621:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1876086274212480:12345-0@lo:103:ldlm_bl.0 Request processed in 29580us (34652us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789175583.035639:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789175583.035729:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789175583.035736:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97e726459800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789175583.035741:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789175583.050280:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.118@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789175583.050289:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789175583.050302:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3cf800 x1876086274211968/t0(0) o400->MGC192.168.201.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789175598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175583.050319:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3cce00 x1876086274212480/t0(0) o103->MGC192.168.201.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789175598 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789175583.050330:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789175583.050333:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789175583.050335:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789175583.050375:0:3305:0:(import.c:65:import_set_state_nolock()) ffff97e726459800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789175583.050382:0:3305:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 139 00000100:00080000:1.0:1789175583.050424:0:3305:0:(import.c:665:import_select_connection()) MGC192.168.201.118@tcp: import ffff97e726459800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175583.050506:0:3305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72e3cd180 x1876086274212608/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789175583.050565:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274211968:0@lo:400:kworker.0 00000100:00100000:1.0:1789175583.050601:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3305:1876086274212480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175583.050713:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274212608:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789175583.050789:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086274212608 offset 0 length 520: 4 00010000:00010000:3.0:1789175583.202420:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175584.225575:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175585.249550:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175586.274113:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175587.234649:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789175587.234664:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789175587.234757:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175587.234784:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274212736:0@lo:400:kworker.0 00000400:00000100:3.0:1789175587.234859:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274212736 offset 0 length 224: 4 00010000:00010000:3.0:1789175587.297863:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175588.321571:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175589.345686:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175590.369618:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175591.393995:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175592.225779:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175582/real 1789175583] req@ffff97e60365d180 x1876086274212352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789175592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175592.227288:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e60365d180 x1876086274212352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789175592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789175592.228072:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e73fcaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789175592.228460:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274212352:0@lo:39:umount.0 00000100:00080000:3.0:1789175592.230143:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789175592.230155:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789175592.230166:0:13119:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789175592.233704:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233731:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233738:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233767:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233801:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175592.233811:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233819:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233825:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.233830:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175592.234425:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789175592.234435:0:13119:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1789175592.234628:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789175592.234638:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234649:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175592.234653:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234662:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175592.234670:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175592.234676:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789175592.234678:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789175592.234681:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789175592.234704:0:6701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:1.0:1789175592.234720:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234727:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e700031600/0x1112cdeac4c1664b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16652 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234746:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175592.234749:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234754:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175592.234757:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234764:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175592.234770:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175592.234775:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789175592.234777:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789175592.234779:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789175592.234785:0:6701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:1.0:1789175592.234788:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234794:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705668400/0x1112cdeac4c16882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16889 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175592.234802:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175592.234809:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175592.234811:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175592.234877:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789175592.234936:0:13119:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789175592.234942:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789175592.234948:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789175592.234955:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789175592.234960:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97e70707cd40) has no exports 00000020:00080000:3.0:1789175592.234992:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff97e70707cd40) has no exports 00000020:01000000:3.0:1789175592.238691:0:13119:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e7076030c0 - data ffff97e73fe0cd80/ffff97e726791000 00000020:01000000:3.0:1789175592.238916:0:13119:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e709430840 - data ffff97e738368ca8/ffff97e737de1000 00100000:10000000:3.0:1789175592.253298:0:13119:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789175592.299854:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1645a 00000020:00000080:2.0:1789175592.299869:0:13119:0:(genops.c:885:class_export_put()) final put ffff97e737ddd800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789175592.299887:0:13119:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e73c3b2800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789175592.299891:0:13119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e73c3b2800 2 00000020:01000004:2.0:1789175592.299895:0:13119:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97e73c3b2800 from lustre-OST0000 00000020:00000080:2.0:1789175592.299927:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789175592.299940:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789175592.299943:0:13119:0:(genops.c:885:class_export_put()) final put ffff97e737ddc000/lustre-OST0000_UUID 00000020:00000080:2.0:1789175592.299946:0:13119:0:(genops.c:844:class_export_destroy()) destroying export ffff97e737ddc000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789175592.299954:0:13119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789175592.300014:0:13119:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789175592.300019:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789175592.300023:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789175592.300029:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789175592.300037:0:13119:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97e73fcad000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789175592.300044:0:13119:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff97e726670000) has exports, disconnecting them 00000020:00080000:2.0:1789175592.300050:0:13119:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97e73fcad000), last request at 1789175373 00000020:00000080:2.0:1789175592.300055:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16484 00000020:00080000:2.0:1789175592.300079:0:13119:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e73fcad000): rc 0 00000020:00000080:2.0:1789175592.300086:0:13119:0:(genops.c:885:class_export_put()) final put ffff97e73fcad000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789175592.300917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e737ddd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789175592.300938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73fcad000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789175592.314461:0:13119:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789175592.314474:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789175592.314487:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789175592.314498:0:13119:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789175592.314803:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175592.314815:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789175592.314825:0:13119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e73c3b2800 1 00000020:00000080:0.0:1789175592.314833:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16414 00000020:00000080:0.0:1789175592.314846:0:13119:0:(genops.c:885:class_export_put()) final put ffff97e72644c000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789175592.314853:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789175592.314863:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789175592.314868:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789175592.314872:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff97e7076db380) has no exports 00000020:00000080:1.0:1789175592.315053:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73fcaf800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789175592.315062:0:36:0:(genops.c:885:class_export_put()) final put ffff97e7264f3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789175592.315066:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7264f3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789175592.315075:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789175592.315150:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e72644c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789175592.337110:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175592.337147:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789175592.337155:0:13119:0:(genops.c:885:class_export_put()) final put ffff97e73c36f000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789175592.337160:0:13119:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73c36f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789175592.337173:0:13119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789175592.337384:0:13119:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97e73c3b7800 00000020:02000400:0.0:1789175592.337495:0:13119:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1789175592.359669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789175592.359679:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789175592.360426:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175592.360469:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274212864:0@lo:400:kworker.0 00000400:00000100:0.0:1789175592.360575:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274212864 offset 0 length 224: 4 00010000:00010000:1.0:1789175592.418632:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175593.250055:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175583/real 1789175583] req@ffff97e72e3cd180 x1876086274212608/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789175593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175593.250100:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e72e3cd180 x1876086274212608/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789175593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789175593.250124:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e726459800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175593.250194:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789175593.250200:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274212608:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789175593.253804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789175593.253818:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789175593.253823:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e726459800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789175593.253834:0:36:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 368 00000100:00080000:1.0:1789175593.253842:0:36:0:(import.c:630:import_select_connection()) MGC192.168.201.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789175593.253851:0:36:0:(import.c:665:import_select_connection()) MGC192.168.201.118@tcp: import ffff97e726459800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175593.253897:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72e3cce00 x1876086274212992/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789175593.254190:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274213120:0@lo:400:kworker.0 00000400:00000100:0.0:1789175593.254262:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274213120 offset 0 length 224: 4 00000100:00100000:2.0:1789175593.254794:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274212992:0@lo:250:kworker.0 00000400:00000100:2.0:1789175593.254829:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086274212992 offset 0 length 520: 4 00010000:00010000:2.0:1789175593.441624:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175594.466279:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789175595.144971:0:13272:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789175595.155798:0:13272:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789175595.155905:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175595.155925:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175595.155935:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175595.155944:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175595.155975:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789175595.155982:0:13272:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789175595.156005:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1789175595.156009:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1789175595.156014:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175595.156021:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030400 already unused, calling callback (ffffffffc1ccec20) 00000100:00100000:2.0:1789175595.156023:0:13272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3ce680 x1876086274212224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175598 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1789175595.156026:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175595.156037:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175595.156053:0:13272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e603909500 x1876086274212736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789175595.156071:0:13272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72643e300 x1876086274212864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1789175595.156080:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175595.156081:0:13272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3cf800 x1876086274213120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175609 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789175595.156086:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789175595.156089:0:6702:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789175595.156092:0:6702:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1789175595.156095:0:13272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789175595.156103:0:13272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789175595.156109:0:6702:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:1.0:1789175595.156113:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175595.156120:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c16621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16628 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175595.156133:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175595.156135:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789175595.156137:0:13272:0:(import.c:65:import_set_state_nolock()) ffff97e73bbab800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789175595.156137:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175595.156242:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1876086274212736:0@lo:400:kworker.0 00000100:00100000:1.0:1789175595.156280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274213248:0@lo:39:umount.0 00000400:00000100:1.0:1789175595.156362:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086274213248 offset 0 length 224: 4 00000100:00100000:3.0:1789175595.156552:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274213120:0@lo:400:kworker.0 00000100:00100000:3.0:1789175595.156567:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274212864:0@lo:400:kworker.0 00000100:00100000:3.0:1789175595.156573:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274212224:0@lo:400:kworker.0 00010000:00010000:1.0:1789175595.489785:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175596.513715:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175597.537590:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175598.498031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789175598.498042:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789175598.562646:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175599.586013:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175600.611172:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175601.633519:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175602.657513:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175603.617469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789175603.617484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789175603.682106:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175604.705678:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175605.345491:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175595/real 1789175595] req@ffff97e60365d180 x1876086274213248/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789175605 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175605.345525:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e60365d180 x1876086274213248/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789175605 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789175605.345563:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e73bbab800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789175605.345587:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274213248:0@lo:39:umount.0 00000100:00080000:2.0:1789175605.345758:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789175605.345763:0:13272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789175605.345769:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789175605.346696:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346709:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346717:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346724:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346752:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175605.346760:0:13272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346766:0:13272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346772:0:13272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346788:0:13272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175605.346814:0:13272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789175605.346819:0:13272:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789175605.346842:0:13272:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789175605.346846:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789175605.346851:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789175605.346856:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789175605.346862:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97e726b819c0) has no exports 00000020:00080000:2.0:1789175605.346888:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff97e726b819c0) has no exports 00000020:01000000:2.0:1789175605.348624:0:13272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e707603c00 - data ffff97e6015d5948/ffff97e726792c00 00000020:01000000:2.0:1789175605.348771:0:13272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97e603a66960 - data ffff97e73ff89288/ffff97e73425dc00 00010000:00010000:3.0:1789175605.349395:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789175605.349405:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349426:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175605.349431:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349443:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175605.349452:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175605.349458:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789175605.349461:0:6702:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789175605.349465:0:6702:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789175605.349482:0:6702:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:3.0:1789175605.349486:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349509:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c1662f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c16636 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349522:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175605.349526:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349532:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175605.349535:0:6702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349543:0:6702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175605.349549:0:6702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175605.349555:0:6702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789175605.349557:0:6702:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789175605.349559:0:6702:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789175605.349565:0:6702:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:3.0:1789175605.349568:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349574:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705669200/0x1112cdeac4c16874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c1687b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175605.349587:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175605.349589:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175605.349596:0:6702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175605.349737:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789175605.373068:0:13272:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789175605.407843:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16525 00000020:00000080:0.0:1789175605.407853:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e734cd2000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789175605.407881:0:13272:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7264f7000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789175605.407884:0:13272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7264f7000 2 00000020:01000004:0.0:1789175605.407901:0:13272:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97e7264f7000 from lustre-OST0001 00000020:00000080:1.0:1789175605.407911:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734cd2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789175605.407930:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175605.407944:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789175605.407947:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e734023000/lustre-OST0001_UUID 00000020:00000080:0.0:1789175605.407951:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734023000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789175605.407957:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789175605.408152:0:13272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e50b439a-f3a6-4419-9d6a-3b18255dcdb8->MGS 00010000:00010000:1.0:1789175605.408170:0:13272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175605.408183:0:13272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175605.408190:0:13272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789175605.408193:0:13272:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789175605.408196:0:13272:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789175605.408212:0:13272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:1.0:1789175605.408217:0:13272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e701526400/0x1112cdeac4c16437 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c1643e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175605.408234:0:13272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175605.408241:0:13272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175605.408247:0:13272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789175605.408249:0:13272:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789175605.408251:0:13272:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789175605.408259:0:13272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97e726459800 00010000:00010000:1.0:1789175605.408270:0:13272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72654be00/0x1112cdeac4c16675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1112cdeac4c1667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789175605.408300:0:13272:0:(import.c:65:import_set_state_nolock()) ffff97e726459800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789175605.408305:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789175605.408307:0:13272:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789175605.408309:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789175605.408314:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789175605.408325:0:13272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97e72e3cce00 x1876086274212992/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789175608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789175605.408367:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789175605.408370:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1789175605.408532:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e50b439a-f3a6-4419-9d6a-3b18255dcdb8:3303:1876086274212992:0@lo:250:kworker.0 10000000:01000000:1.0:1789175605.408757:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789175605.408765:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c16318 00000020:00000080:1.0:1789175605.408770:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e707184800/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 00000020:01000000:1.0:1789175605.408786:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.118@tcp (flags='') 00000020:00000080:1.0:1789175605.408790:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789175605.408795:0:13272:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789175605.408799:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff97e7070799c0) has no exports 10000000:01000000:1.0:1789175605.408814:0:5835:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789175605.408860:0:13272:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.118@tcp: client import never connected 00000100:00080000:1.0:1789175605.408863:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789175605.408865:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789175605.408867:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789175605.408869:0:13272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789175605.408908:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789175605.408913:0:13272:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.118@tcp (uuid e50b439a-f3a6-4419-9d6a-3b18255dcdb8) 00000020:01000000:1.0:1789175605.408917:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789175605.408920:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789175605.408924:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789175605.408929:0:13272:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97e73bbae000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789175605.408935:0:13272:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff97e73be2cd40) has exports, disconnecting them 00000020:00080000:1.0:1789175605.408945:0:13272:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97e73bbae000), last request at 1789175394 00000020:00000080:1.0:1789175605.408949:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c1654f 00000020:00080000:1.0:1789175605.408959:0:13272:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff97e73bbae000): rc 0 00000020:00000080:1.0:1789175605.408962:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e73bbae000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789175605.409133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e707184800/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 for MGC192.168.201.118@tcp 00000020:00000080:0.0:1789175605.409141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73bbae000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789175605.410365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e726459800 for MGC192.168.201.118@tcp 00000020:00000080:0.0:1789175605.410378:0:36:0:(genops.c:885:class_export_put()) final put ffff97e72645f800/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 00000020:00000080:0.0:1789175605.410380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e72645f800/e50b439a-f3a6-4419-9d6a-3b18255dcdb8 for MGC192.168.201.118@tcp 00000020:01000000:0.0:1789175605.410387:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.118@tcp (e50b439a-f3a6-4419-9d6a-3b18255dcdb8) 00010000:01000000:0.0:1789175605.413439:0:13272:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789175605.413449:0:13272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789175605.413454:0:13272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789175605.413461:0:13272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789175605.413581:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff97e73bbab800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789175605.415416:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789175605.415601:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789175605.415831:0:6702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789175605.416009:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789175605.416284:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97e72660ae00:5821] 0 exiting: rc = 1 00000100:00100000:0.0:1789175605.416355:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97e72660aa00:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.416486:0:11665:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff97e73be50600:11665] 2 exiting: rc = 0 00000100:00100000:3.0:1789175605.416545:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.418009:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97e7265c2600:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1789175605.418069:0:12965:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff97e7096cdc00:12965] 4 exiting: rc = 0 00000100:00100000:3.0:1789175605.418244:0:8505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97e72660c800:8505] 3 exiting: rc = 0 00000100:00100000:0.0:1789175605.418543:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97e7265c3200:5825] 2 exiting: rc = 0 00000100:00100000:3.0:1789175605.418786:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97e7265c3800:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.418842:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.418851:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.418856:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.418861:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.418866:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421181:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421206:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421214:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421220:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421227:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421233:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421239:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421245:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421251:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421257:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421357:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421370:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421376:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421381:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421387:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421391:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421395:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421401:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421405:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421410:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421436:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421441:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421446:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421451:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421456:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421460:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421465:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421470:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421475:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421481:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421486:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421491:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421496:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421502:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421508:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421514:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421520:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421525:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421533:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421539:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421545:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421552:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421558:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421564:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421569:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421574:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421580:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421586:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421593:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421599:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421605:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421611:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421617:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421623:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421629:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421641:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421647:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421653:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.421789:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789175605.426864:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175605.426878:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789175605.426884:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e73bbaf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789175605.426888:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff97e73bbaf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789175605.426896:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789175605.426973:0:13272:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7264f7000 1 00000020:00000080:0.0:1789175605.426980:0:13272:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1112cdeac4c164f4 00000020:00000080:0.0:1789175605.426987:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e734020800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789175605.427000:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789175605.427005:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789175605.427012:0:13272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789175605.427017:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff97e726674d40) has no exports 00000020:00000080:3.0:1789175605.427022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97e734020800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789175605.452717:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175605.452731:0:13272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789175605.452737:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e7264f2800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789175605.452742:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff97e7264f2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789175605.452749:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789175605.454248:0:13272:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97e7264f2000 00000020:01000000:0.0:1789175605.454353:0:13272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789175605.454360:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789175605.454365:0:13272:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789175605.454370:0:13272:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff97e726b83380) has no exports 00000020:00000080:0.0:1789175605.454397:0:13272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789175605.454405:0:13272:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789175605.454953:0:13272:0:(genops.c:885:class_export_put()) final put ffff97e726449800/OSS_uuid 00000020:00000080:0.0:1789175605.454957:0:13272:0:(genops.c:844:class_export_destroy()) destroying export ffff97e726449800/OSS_uuid for OSS 00000020:01000000:0.0:1789175605.454963:0:13272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789175605.455667:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97e73bad4a00:6686] 1 exiting: rc = 0 00000100:00080000:2.0:1789175605.455758:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789175605.455797:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97e73bad4e00:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1789175605.455839:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97e73bad5c00:6687] 2 exiting: rc = 0 00000100:00100000:2.0:1789175605.455977:0:12165:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff97e737c08000:12165] 3 exiting: rc = 0 00000100:00100000:3.0:1789175605.465664:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465676:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465694:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465702:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465715:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465724:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465730:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465739:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465746:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465752:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465758:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465763:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465775:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465781:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465786:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465791:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465796:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465802:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465807:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465812:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465817:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465828:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465835:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465840:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465846:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465852:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465858:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465864:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465869:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465876:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465892:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465897:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465903:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465911:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465916:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465921:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465937:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465947:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465953:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465959:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465969:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465975:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465980:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465985:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465990:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.465995:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466003:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466008:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466013:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466017:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466022:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466027:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466032:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466037:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466043:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466048:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466130:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466140:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466146:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466151:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466156:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466162:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466167:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.466572:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175605.470422:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97e73b8e9a00:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.471067:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97e7070afa00:6689] 0 exiting: rc = 1 00000100:00100000:3.0:1789175605.471391:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.471403:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472041:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472063:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472069:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472075:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472081:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472086:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472092:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472097:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472103:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472108:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472113:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472118:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472123:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472129:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472135:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472141:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472147:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472152:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472158:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472164:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472170:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472176:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472182:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472188:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472194:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472200:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472205:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472210:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472215:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472220:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472225:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472231:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472237:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472255:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.472259:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473598:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473613:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473621:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473628:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473633:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473638:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473643:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473648:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473652:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473657:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473662:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473668:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473673:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473679:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473945:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473950:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473956:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473962:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473968:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473973:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473978:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473983:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473988:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473993:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.473997:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.474002:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.474008:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175605.483078:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97e73b8e8c00:6691] 0 exiting: rc = 1 00000100:00100000:3.0:1789175605.483187:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97e73b8ea400:6693] 2 exiting: rc = 0 00000100:00100000:1.0:1789175605.484336:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97e73b8ebe00:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.484772:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484781:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484788:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484796:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484802:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484820:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484827:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484833:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484840:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484846:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484853:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484858:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484864:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484869:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484875:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484881:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484887:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484893:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484899:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484918:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.484927:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.485976:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.485990:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486001:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486010:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486016:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486022:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486032:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486039:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486049:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486056:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486062:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486069:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486075:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486083:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486089:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486096:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486102:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486778:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486788:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486805:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486811:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486818:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486844:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486852:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486858:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486865:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486872:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486877:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486883:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486889:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486896:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486903:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486908:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486915:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486921:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486927:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486933:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486939:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486946:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486952:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486958:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486964:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.486971:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175605.503019:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97e73b8eb600:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1789175605.507843:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97e73b8ea200:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.507905:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507913:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507919:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507925:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507931:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507939:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507947:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.507955:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508122:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508135:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508143:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508163:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508168:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508179:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508562:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508575:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508580:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508585:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508597:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508603:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508608:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508614:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508620:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508626:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508631:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508637:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508644:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508649:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508655:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.508660:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512586:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512602:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512607:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512612:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512622:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512628:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512633:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512638:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512644:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512649:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512655:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512660:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512972:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512981:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512986:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.512992:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513011:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513017:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513022:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513027:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513033:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513037:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513042:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513047:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513052:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513057:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513061:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513066:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513071:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513077:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513082:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513087:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513092:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.513097:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789175605.516394:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97e73bad4000:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1789175605.516407:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97e73bad7800:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1789175605.516716:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516725:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516732:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516738:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516764:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516770:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516776:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516782:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516788:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516794:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516799:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516805:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516816:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516822:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516830:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516836:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516853:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516868:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516874:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516880:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516886:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516891:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516897:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516902:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516909:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516914:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516920:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516926:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516945:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516952:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516958:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516963:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516969:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516974:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516980:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516986:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.516994:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517000:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517005:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517011:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517030:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517038:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517044:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517051:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517058:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517064:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517070:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517077:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517083:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517089:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517098:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517104:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517127:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517133:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517138:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517144:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517150:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517156:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517162:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517168:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517174:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517180:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517185:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789175605.517192:0:13272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789175605.538255:0:13272:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789175621.818264:0:13887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789175630.243921:0:14349:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789175630.243928:0:14349:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789175630.244132:0:14349:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e73474e000 00000020:01000004:1.0:1789175630.244148:0:14349:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789175630.244156:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789175630.244173:0:14349:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97e707078000) 00000020:00000080:1.0:1789175630.244185:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789175630.262597:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789175630.267431:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789175630.270193:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 375: rc = 0 00100000:10000000:1.0:1789175630.270295:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 375: rc = 0 00100000:10000000:1.0:1789175630.270425:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 375: rc = 0 00100000:10000000:1.0:1789175630.270521:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 375: rc = 0 00100000:10000000:1.0:1789175630.270703:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789175630.270771:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 375: rc = 0 00100000:10000000:1.0:1789175630.270878:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 375: rc = 0 00100000:10000000:1.0:1789175630.271126:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 377: rc = 0 00100000:10000000:1.0:1789175630.272177:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 464: rc = 0 00100000:10000000:1.0:1789175630.272279:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 464: rc = 0 00100000:10000000:1.0:1789175630.272808:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.277722:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 472: rc = 0 00100000:10000000:1.0:1789175630.278083:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 472: rc = 0 00100000:10000000:1.0:1789175630.278398:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.278663:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 472: rc = 0 00100000:10000000:1.0:1789175630.278919:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.279172:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.279421:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 472: rc = 0 00100000:10000000:1.0:1789175630.279659:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.279925:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 472: rc = 0 00100000:10000000:1.0:1789175630.280189:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 472: rc = 0 00100000:10000000:1.0:1789175630.280472:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 472: rc = 0 00100000:10000000:1.0:1789175630.284316:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 569: rc = 0 00100000:10000000:1.0:1789175630.284780:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 569: rc = 0 00100000:10000000:1.0:1789175630.285142:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 569: rc = 0 00100000:10000000:1.0:1789175630.286139:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 569: rc = 0 00100000:10000000:1.0:1789175630.287189:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 569: rc = 0 00100000:10000000:1.0:1789175630.288989:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 569: rc = 0 00100000:10000000:1.0:1789175630.289972:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 569: rc = 0 00100000:10000000:1.0:1789175630.290937:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 569: rc = 0 00100000:10000000:1.0:1789175630.291513:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 569: rc = 0 00100000:10000000:1.0:1789175630.292296:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 569: rc = 0 00100000:10000000:1.0:1789175630.293679:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 569: rc = 0 00100000:10000000:1.0:1789175630.294605:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 569: rc = 0 00100000:10000000:1.0:1789175630.295933:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 569: rc = 0 00100000:10000000:1.0:1789175630.296909:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 569: rc = 0 00100000:10000000:1.0:1789175630.297193:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 569: rc = 0 00100000:10000000:1.0:1789175630.298140:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 569: rc = 0 00100000:10000000:1.0:1789175630.299115:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 569: rc = 0 00100000:10000000:1.0:1789175630.299644:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 569: rc = 0 00100000:10000000:1.0:1789175630.301103:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 569: rc = 0 00100000:10000000:1.0:1789175630.301750:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 569: rc = 0 00100000:10000000:1.0:1789175630.302030:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 569: rc = 0 00100000:10000000:1.0:1789175630.303593:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 569: rc = 0 00100000:10000000:1.0:1789175630.303843:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 569: rc = 0 00100000:10000000:1.0:1789175630.304094:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 569: rc = 0 00100000:10000000:1.0:1789175630.306307:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 569: rc = 0 00100000:10000000:1.0:1789175630.306707:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 569: rc = 0 00100000:10000000:1.0:1789175630.308464:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 569: rc = 0 00100000:10000000:1.0:1789175630.308733:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 569: rc = 0 00100000:10000000:1.0:1789175630.310477:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 569: rc = 0 00100000:10000000:1.0:1789175630.310747:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 569: rc = 0 00100000:10000000:1.0:1789175630.311705:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 569: rc = 0 00100000:10000000:1.0:1789175630.312610:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 569: rc = 0 00100000:10000000:1.0:1789175630.314170:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 486: rc = 0 00100000:10000000:1.0:1789175630.316073:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789175630.316622:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 465: rc = 0 00100000:10000000:1.0:1789175630.317095:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789175630.317172:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 465: rc = 0 00100000:10000000:1.0:1789175630.317431:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789175630.317505:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 465: rc = 0 00100000:10000000:1.0:1789175630.317897:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789175630.317967:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 468: rc = 0 00100000:10000000:1.0:1789175630.318155:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789175630.318230:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 468: rc = 0 00100000:10000000:1.0:1789175630.318432:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789175630.318500:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 468: rc = 0 00000020:00000080:1.0:1789175630.318787:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789175630.318797:0:14349:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789175630.318809:0:14349:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c17619 00000020:01000004:1.0:1789175630.318818:0:14349:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789175630.318824:0:14349:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789175630.318829:0:14349:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e73474e000 from MGS 00000020:01000004:1.0:1789175630.318833:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789175630.318844:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97e70707b380) 00000020:00000080:1.0:1789175630.318854:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789175630.318931:0:14349:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e73474e000 from MGS, refs=2 00080000:01000000:1.0:1789175630.318937:0:14349:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789175630.318942:0:14349:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c17627 00000100:00100000:1.0:1789175630.319040:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789175630.319174:0:14349:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789175630.319180:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789175630.329250:0:14349:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789175630.329266:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789175630.330337:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175630.330565:0:14349:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789175630.330571:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789175630.334662:0:14349:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789175630.334674:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789175630.335191:0:14349:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789175630.335197:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789175630.338284:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.338290:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.338293:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.338737:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.338740:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.338743:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175630.352820:0:14349:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789175630.359143:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789175630.371194:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789175630.371217:0:14349:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789175630.371220:0:14349:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789175630.375191:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789175630.375436:0:14349:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789175630.375557:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789175630.376202:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789175630.376529:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789175630.376685:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789175630.376690:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789175630.384745:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789175630.384759:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789175630.390279:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789175630.390294:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789175630.398101:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789175630.398128:0:14349:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:0.0:1789175630.398130:0:14349:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789175630.398164:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:0.0:1789175630.398178:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (ffff97e726674d40) 00000020:00000080:0.0:1789175630.398194:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789175630.398277:0:14349:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e737ce0800@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1789175630.398464:0:14349:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:0.0:1789175630.398470:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789175630.398790:0:14363:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789175630.399880:0:14364:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789175630.399944:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid 71fe837c-1812-4075-866f-5d0b367ca590) 00000020:00000080:0.0:1789175630.399961:0:14349:0:(genops.c:1385:class_connect()) connect: client 71fe837c-1812-4075-866f-5d0b367ca590, cookie 0x1112cdeac4c17635 00000100:00080000:0.0:1789175630.399972:0:14349:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789175630.399991:0:14349:0:(import.c:665:import_select_connection()) MGC192.168.201.118@tcp: import ffff97e737ce0800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1789175630.400024:0:14349:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72643f480 x1876086274213376/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789175630.400053:0:14349:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 71fe837c-1812-4075-866f-5d0b367ca590->MGS 00000020:01000004:0.0:1789175630.400067:0:14349:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789175630.400072:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789175630.400083:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97e726673380) 00000020:00000080:0.0:1789175630.400098:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789175630.402967:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71fe837c-1812-4075-866f-5d0b367ca590:3303:1876086274213376:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789175630.403054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.403134:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274213376 00000100:00100000:1.0:1789175630.403142:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274213376 00000100:00100000:1.0:1789175630.403175:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175630.403183:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1876086274213376:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789175630.403208:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 71fe837c-1812-4075-866f-5d0b367ca590@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:1.0:1789175630.403236:0:14360:0:(genops.c:1385:class_connect()) connect: client 71fe837c-1812-4075-866f-5d0b367ca590, cookie 0x1112cdeac4c17643 00000100:00080000:1.0:1789175630.403385:0:14360:0:(import.c:65:import_set_state_nolock()) ffff97e73c36a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175630.403446:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+5:3303:x1876086274213376:12345-0@lo:250:mount.lustre.0 Request processed in 261us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.403453:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175630.403502:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789175630.403511:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:1.0:1789175630.403517:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789175630.403522:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789175630.403525:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789175630.403528:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789175630.403536:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789175630.403541:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71fe837c-1812-4075-866f-5d0b367ca590:3303:1876086274213376:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789175630.409027:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789175630.409244:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789175630.409252:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789175630.409989:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789175630.409999:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789175630.410297:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789175630.410303:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789175630.410943:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175630.411105:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789175630.411110:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789175630.418631:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789175630.418642:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789175630.473951:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175630.474187:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789175630.474194:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789175630.475588:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789175630.475600:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789175630.477813:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175630.478038:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789175630.478045:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789175630.478656:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789175630.478664:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789175630.479172:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175630.479308:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789175630.479312:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789175630.485737:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789175630.485752:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789175630.486469:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789175630.486645:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789175630.486651:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789175630.487170:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789175630.487177:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789175630.560203:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175630.560533:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789175630.560541:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789175630.563961:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789175630.563978:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789175630.574248:0:14349:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789175630.574269:0:14349:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789175630.582625:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789175630.582659:0:14349:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789175630.582665:0:14349:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789175630.582816:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789175630.582879:0:14349:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789175630.582883:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789175630.582885:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789175630.582887:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175630.582888:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175630.582889:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175630.582891:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175630.582893:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789175630.582894:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789175630.582896:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175630.582898:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789175630.582901:0:14349:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789175630.582903:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789175630.582904:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789175630.582906:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175630.582907:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175630.582911:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175630.582913:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175630.582914:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789175630.582915:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789175630.582916:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175630.582917:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789175630.582943:0:14349:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789175630.582964:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789175630.583035:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.583074:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72f49e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.583211:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274213504 00000100:00100000:0.0:1789175630.583219:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274213504 00000100:00100000:0.0:1789175630.583265:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175630.583275:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+5:14349:x1876086274213504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789175630.583315:0:14362:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789175630.583319:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789175630.583322:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789175630.583755:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789175630.584192:0:14362:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789175630.585229:0:14384:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789175630.585236:0:14384:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789175630.585239:0:14384:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789175630.585272:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789175630.585683:0:14362:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789175630.585695:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789175630.597284:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+5:14349:x1876086274213504:12345-0@lo:253:mount.lustre.0 Request processed in 14001us (14239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.597297:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175630.597906:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789175630.597925:0:14349:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789175630.597929:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789175630.597931:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789175630.597932:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175630.597933:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175630.597935:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175630.597936:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175630.597938:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789175630.597939:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789175630.597941:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175630.597943:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789175630.597964:0:14349:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e73474e000 from lustre-MDT0000 10000000:01000000:1.0:1789175630.598005:0:14349:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789175630.598009:0:14349:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789175630.598013:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97e726674d40 10000000:01000000:1.0:1789175630.598017:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789175630.598025:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97e726674d40 from 1 10000000:01000000:1.0:1789175630.598028:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789175630.598068:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.598080:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.598107:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175630.598130:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789175630.598174:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.598220:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72f49e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789175630.598287:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274213632 00000100:00100000:2.0:1789175630.598294:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274213632 00000100:00100000:2.0:1789175630.598372:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789175630.598384:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+5:14349:x1876086274213632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789175630.598399:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175630.598416:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72e1b5800/0x1112cdeac4c17651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1764a expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.598442:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72e1b5800/0x1112cdeac4c17651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1764a expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.598455:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72e1b5800/0x1112cdeac4c17651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1764a expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.598466:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5800, rc 0) 00000100:00100000:0.0:1789175630.598970:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+6:14349:x1876086274213632:12345-0@lo:101:mount.lustre.0 Request processed in 586us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.598978:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175630.599069:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175630.599085:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.599093:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175630.599144:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175630.599170:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.599201:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72f49e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.599211:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274213760 00000100:00100000:0.0:1789175630.599216:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274213760 00000100:00100000:0.0:1789175630.599248:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175630.599256:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+6:14349:x1876086274213760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789175630.599529:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+6:14349:x1876086274213760:12345-0@lo:501:mount.lustre.0 Request processed in 274us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175630.599543:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789175630.599906:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213760:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789175630.599929:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789175630.599953:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.599961:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175630.599969:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e73474e000 10000000:01000000:1.0:1789175630.599985:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789175630.599995:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97e73474e000 10000000:01000000:1.0:1789175630.599998:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789175630.600001:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97e73474e000 from 1 10000000:01000000:1.0:1789175630.600003:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789175630.600025:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.600033:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.600042:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175630.600055:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789175630.600082:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.600112:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72f49e900 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.601235:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274213888 00000100:00100000:0.0:1789175630.601245:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274213888 00000100:00100000:0.0:1789175630.601293:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789175630.601301:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+6:14349:x1876086274213888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175630.601313:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175630.601371:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705669a00/0x1112cdeac4c1765f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17658 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.601397:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705669a00/0x1112cdeac4c1765f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17658 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.601408:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705669a00/0x1112cdeac4c1765f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17658 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.601418:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669a00, rc 0) 00000100:00100000:0.0:1789175630.601473:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+7:14349:x1876086274213888:12345-0@lo:101:mount.lustre.0 Request processed in 173us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.601481:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175630.601588:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274213888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175630.601603:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1765f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175630.601614:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1765f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175630.601628:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789175630.601635:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1765f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175630.601643:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654b000/0x1112cdeac4c17658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1765f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175630.601651:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789175630.601655:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175630.601660:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97e73474e000 10000000:01000000:3.0:1789175630.601662:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789175630.601666:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789175630.601669:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789175630.601700:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175630.601709:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175630.601717:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175630.601735:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789175630.601767:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175630.601803:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7112fea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.601953:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214016 00000100:00100000:1.0:1789175630.601958:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214016 00000100:00100000:1.0:1789175630.602032:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789175630.602041:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+7:14349:x1876086274214016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175630.602048:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175630.602058:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c1766d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17666 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.602073:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c1766d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17666 expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.602081:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654ac00/0x1112cdeac4c1766d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17666 expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.602103:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ac00, rc 0) 00000100:00100000:1.0:1789175630.602145:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+8:14349:x1876086274214016:12345-0@lo:101:mount.lustre.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.602151:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175630.602218:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175630.602228:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1766d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175630.602236:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1766d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175630.602283:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175630.602308:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175630.605597:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7112fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175630.609071:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214144 00000100:00100000:2.0:1789175630.609088:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214144 00000100:00100000:3.0:1789175630.609509:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175630.609521:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+8:14349:x1876086274214144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175630.609994:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+9:14349:x1876086274214144:12345-0@lo:501:mount.lustre.0 Request processed in 473us (7683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.610003:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789175630.610112:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175630.610170:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.610220:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.610257:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175630.610264:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214272 00000100:00100000:3.0:1789175630.610275:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214272 00000100:00100000:3.0:1789175630.610296:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175630.610302:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+9:14349:x1876086274214272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175630.610629:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+9:14349:x1876086274214272:12345-0@lo:503:mount.lustre.0 Request processed in 325us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.610636:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789175630.612964:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.614969:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14385:1876086274214400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.615142:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.615195:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7062acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789175630.615479:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214400 00000100:00100000:3.0:1789175630.615486:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214400 00000100:00100000:3.0:1789175630.615524:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175630.615534:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+9:14385:x1876086274214400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789175630.615903:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+9:14385:x1876086274214400:12345-0@lo:502:llog_process_th.0 Request processed in 369us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.615913:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789175630.616091:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14385:1876086274214400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175630.616132:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.616145:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.616147:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789175630.616152:0:14385:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789175630.616154:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175630.616172:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97e73be299c0) 00000020:00000080:2.0:1789175630.616193:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789175630.616199:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789175630.616274:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789175630.616281:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c1767b 00000020:00000080:2.0:1789175630.616586:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789175630.616591:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.616594:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.616596:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789175630.616599:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.616602:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.616604:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789175630.616607:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175630.616614:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97e73be28000) 00000020:00000080:2.0:1789175630.616627:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789175630.616631:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789175630.616633:0:14385:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789175630.616637:0:14385:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789175630.616643:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789175630.616686:0:14385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e73474e000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789175630.616700:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97e73be2cd40) 00000020:00000080:2.0:1789175630.616707:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789175630.616763:0:14385:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789175630.616768:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c17690 00000020:00000080:3.0:1789175630.616969:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789175630.616976:0:14385:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789175630.616982:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1112cdeac4c17697 00080000:01000000:3.0:1789175630.616987:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789175630.616991:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c1769e 00010000:00010000:0.0:1789175630.740523:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789175630.740953:0:14385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1789175630.741135:0:14385:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789175630.741685:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97e726670000) 00000020:00000080:0.0:1789175630.741704:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789175630.741764:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789175630.741771:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c176ac 00000020:00000080:0.0:1789175630.744255:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789175630.751648:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1112cdeac4c176b3 00000020:00000080:2.0:1789175630.754589:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789175630.754604:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.754611:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.754627:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789175630.754631:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.754637:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.754639:0:14385:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789175630.754643:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789175630.754694:0:14385:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789175630.754706:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.754710:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.754711:0:14385:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789175630.754713:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789175630.754715:0:14385:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1789175630.754717:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789175630.754719:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789175630.754721:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789175630.754723:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.754725:0:14385:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789175630.754727:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789175630.754730:0:14385:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789175630.754734:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.754735:0:14385:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789175630.754738:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789175630.754744:0:14385:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:2.0:1789175630.754773:0:14385:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789175630.754775:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175630.754792:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97e73be2b380) 00000020:00000080:2.0:1789175630.754809:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789175630.754814:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789175630.754895:0:14385:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789175630.754903:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789175630.754910:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c176c1 00010000:00080000:2.0:1789175630.754941:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e7267e5000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175630.755221:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789175630.755670:0:14385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789175630.755735:0:14385:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789175630.756728:0:14385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175630.756782:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789175630.756863:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789175630.759536:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789175630.759544:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789175630.762097:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789175630.762109:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789175630.762145:0:14385:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789175630.762162:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c176c8 00000100:00080000:1.0:1789175630.762172:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789175630.762179:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97e7267e5000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175630.762214:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72e3cf100 x1876086274214528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789175630.762247:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789175630.762296:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274214528:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1789175630.762305:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789175630.762309:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175630.762311:0:14385:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789175630.762313:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789175630.762316:0:14385:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789175630.762317:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789175630.762318:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789175630.762320:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789175630.762322:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175630.762323:0:14385:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789175630.762338:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789175630.762363:0:14385:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789175630.762367:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789175630.762368:0:14385:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789175630.762371:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789175630.762380:0:14385:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000400:00000100:2.0:1789175630.762388:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086274214528 offset 0 length 520: 4 00000020:01000000:1.0:1789175630.763444:0:14385:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789175630.763452:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789175630.763469:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97e7070799c0) 00000020:00000080:1.0:1789175630.763487:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789175630.763494:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789175630.763575:0:14385:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789175630.763582:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789175630.763588:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1112cdeac4c176d6 00010000:00080000:1.0:1789175630.763627:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e737ce4000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1789175630.767301:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789175630.767575:0:14385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789175630.767599:0:14385:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789175630.768663:0:14385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789175630.768737:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789175630.770441:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789175630.771394:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789175630.771400:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789175630.778629:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789175630.778647:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789175630.778692:0:14385:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789175630.778713:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c176dd 00000100:00080000:2.0:1789175630.778726:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175630.778732:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e737ce4000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175630.778770:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60365df80 x1876086274214656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789175630.778876:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274214656:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789175630.778936:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086274214656 offset 0 length 520: 4 00000100:00080000:2.0:1789175630.779052:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789175630.779110:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.779114:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.779116:0:14385:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789175630.779119:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.779123:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.779124:0:14385:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789175630.779127:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789175630.779129:0:14385:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789175630.779131:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.779133:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.779134:0:14385:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789175630.779136:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.779138:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.779146:0:14385:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789175630.779151:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789175630.779181:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14385:1876086274214784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.779228:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.779249:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.780129:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214784 00000100:00100000:0.0:1789175630.780150:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214784 00000100:00100000:0.0:1789175630.780206:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175630.780216:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+9:14385:x1876086274214784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789175630.780525:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+9:14385:x1876086274214784:12345-0@lo:502:llog_process_th.0 Request processed in 310us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.780533:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789175630.780801:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14385:1876086274214784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175630.780836:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.780843:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.780846:0:14385:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789175630.780872:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789175630.781191:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789175630.781214:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789175630.781239:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1766d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781250:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f8200/0x1112cdeac4c17666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1766d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175630.781257:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e73474e000 from 1 10000000:01000000:0.0:1789175630.781261:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789175630.781296:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781304:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781314:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175630.781335:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789175630.781394:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175630.781434:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70545df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.781452:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274214912 00000100:00100000:0.0:1789175630.781464:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274214912 00000100:00100000:0.0:1789175630.781493:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175630.781500:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+9:14349:x1876086274214912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175630.781510:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175630.781523:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c176e4 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781546:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781557:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781565:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668800, rc 0) 00000100:00100000:0.0:1789175630.781599:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+10:14349:x1876086274214912:12345-0@lo:101:mount.lustre.0 Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.781605:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175630.781641:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274214912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175630.781653:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.781662:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175630.783092:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215040:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789175630.783156:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175630.783264:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70545df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789175630.785467:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215040 00000100:00100000:3.0:1789175630.785482:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215040 00000100:00100000:3.0:1789175630.785544:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789175630.785554:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+10:14349:x1876086274215040:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789175630.785579:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789175630.785587:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789175630.785707:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+10:14349:x1876086274215040:12345-0@lo:256:mount.lustre.0 Request processed in 155us (2551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.785715:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175630.785832:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215040:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789175630.786487:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789175630.786501:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.786513:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175630.786521:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73474e000 from 1 10000000:01000000:2.0:1789175630.786524:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175630.786562:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.786570:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.786580:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175630.786602:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789175630.786655:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.786688:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.789044:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215168 00000100:00100000:1.0:1789175630.789060:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215168 00000100:00100000:1.0:1789175630.789112:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789175630.789121:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+10:14349:x1876086274215168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175630.789136:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175630.789159:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c176f2 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.789189:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.789219:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.789228:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a600, rc 0) 00000100:00100000:1.0:1789175630.789305:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215168:12345-0@lo:101:mount.lustre.0 Request processed in 185us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.789312:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175630.789634:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789175630.789654:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.789663:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175630.789739:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175630.789773:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.789798:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.789924:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215296 00000100:00100000:1.0:1789175630.789928:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215296 00000100:00100000:1.0:1789175630.789961:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789175630.790067:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175630.790590:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215296:12345-0@lo:501:mount.lustre.0 Request processed in 620us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.790597:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789175630.793204:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175630.793270:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.793508:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.793581:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175630.795147:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215424 00000100:00100000:3.0:1789175630.795174:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215424 00000100:00100000:3.0:1789175630.795293:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175630.795305:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175630.795575:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215424:12345-0@lo:503:mount.lustre.0 Request processed in 272us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.795582:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789175630.795697:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.799557:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14393:1876086274215552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.799657:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.799864:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.800181:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215552 00000100:00100000:1.0:1789175630.800191:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215552 00000100:00100000:1.0:1789175630.800239:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789175630.800250:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14393:x1876086274215552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175630.800572:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14393:x1876086274215552:12345-0@lo:502:llog_process_th.0 Request processed in 322us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.800580:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789175630.800717:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14393:1876086274215552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175630.800753:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.800763:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.800766:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789175630.800773:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e73474e000 00000020:00000080:2.0:1789175630.800782:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789175630.800791:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.800794:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.800795:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789175630.800798:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.800801:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.800802:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789175630.800806:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e73474e000 00000020:00000080:2.0:1789175630.800808:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789175630.800875:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.800879:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.800880:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789175630.800883:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175630.800886:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.800887:0:14393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789175630.800891:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e73474e000 00000020:00000080:2.0:1789175630.800893:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789175630.800937:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14393:1876086274215680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.801054:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.801078:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.801171:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215680 00000100:00100000:1.0:1789175630.801176:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215680 00000100:00100000:1.0:1789175630.801196:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175630.801203:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14393:x1876086274215680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175630.801363:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14393:x1876086274215680:12345-0@lo:502:llog_process_th.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.801377:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789175630.803252:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14393:1876086274215680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789175630.803298:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175630.803308:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175630.803310:0:14393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789175630.803315:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789175630.804948:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789175630.805047:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175630.805069:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.805082:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175630.805138:0:14349:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789175630.805141:0:14349:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e73474e000 10000000:01000000:2.0:1789175630.805144:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e73474e000 10000000:01000000:2.0:1789175630.805148:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789175630.805154:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e73474e000 from 1 10000000:01000000:2.0:1789175630.805156:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789175630.805189:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.805198:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.805208:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175630.805231:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789175630.805297:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.805360:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.805434:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215808 00000100:00100000:0.0:1789175630.805448:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215808 00000100:00100000:0.0:1789175630.805503:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789175630.805513:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274215808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175630.805527:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175630.805540:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705669800/0x1112cdeac4c17707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17700 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.805566:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705669800/0x1112cdeac4c17707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17700 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.805577:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705669800/0x1112cdeac4c17707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17700 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.805586:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669800, rc 0) 00000100:00100000:0.0:1789175630.805630:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274215808:12345-0@lo:101:mount.lustre.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.805637:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789175630.807133:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789175630.807160:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17707 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.807174:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17707 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175630.807245:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175630.807293:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.807337:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.807429:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274215936 00000100:00100000:0.0:1789175630.807435:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274215936 00000100:00100000:0.0:1789175630.807478:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789175630.807487:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274215936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789175630.807751:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274215936:12345-0@lo:501:mount.lustre.0 Request processed in 264us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.807758:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789175630.808159:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274215936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175630.808193:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274216064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.808236:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.808268:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175630.808317:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216064 00000100:00100000:3.0:1789175630.808322:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216064 00000100:00100000:3.0:1789175630.808382:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789175630.808391:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274216064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175630.808547:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274216064:12345-0@lo:503:mount.lustre.0 Request processed in 158us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175630.808553:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789175630.809101:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274216064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175630.818121:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14396:1876086274216192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.818208:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.818253:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc540 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.818457:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216192 00000100:00100000:1.0:1789175630.818465:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216192 00000100:00100000:1.0:1789175630.818506:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789175630.818514:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:14396:x1876086274216192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789175630.818780:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:14396:x1876086274216192:12345-0@lo:502:llog_process_th.0 Request processed in 265us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175630.818801:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789175630.818913:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14396:1876086274216192:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789175630.819045:0:14396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789175630.819069:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97e73c4fb380) 00000020:00000080:2.0:1789175630.819089:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789175630.819159:0:14396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e73474e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789175630.819162:0:14396:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e73474e000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789175630.819165:0:14396:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e73474e000 4 00010000:00080000:2.0:1789175630.819190:0:14396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e726448800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175630.824490:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789175630.824738:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789175630.824776:0:14396:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789175630.824791:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1112cdeac4c17715 00000100:00080000:2.0:1789175630.824802:0:14396:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175630.824809:0:14396:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97e726448800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175630.824844:0:14396:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60365ea00 x1876086274216320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789175630.824897:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274216320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789175630.824991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175630.825035:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216320 00000100:00100000:1.0:1789175630.825042:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216320 00000100:00080000:2.0:1789175630.825047:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789175630.825071:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789175630.825080:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274216320:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789175630.825089:0:14367:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789175630.825096:0:14367:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789175630.825137:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1876086274216320:12345-0@lo:38:llog_process_th.0 Request processed in 57us (145us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789175630.825145:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175630.826467:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789175630.826672:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e726448800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789175630.826681:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789175630.826687:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274216320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789175630.827109:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14396:1876086274216448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.827176:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.827208:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216448 00000100:00100000:2.0:1789175630.827212:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216448 00000100:00100000:2.0:1789175630.827246:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175630.827254:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14396:x1876086274216448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789175630.827518:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14396:x1876086274216448:12345-0@lo:502:llog_process_th.0 Request processed in 264us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175630.827527:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175630.827569:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789175630.827584:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:71fe837c-1812-4075-866f-5d0b367ca590:14396:1876086274216448:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789175630.827605:0:14396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789175630.827658:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789175630.827675:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789175630.827688:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17707 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.827700:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4000/0x1112cdeac4c17700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17707 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789175630.827745:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789175630.827747:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789175630.827749:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175630.827750:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175630.827751:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175630.827753:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175630.827754:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789175630.827756:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789175630.827757:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175630.827759:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789175630.827762:0:14349:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789175630.827764:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789175630.827766:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789175630.827767:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175630.827768:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175630.827769:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175630.827770:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175630.827771:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789175630.827772:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789175630.827773:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175630.827774:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789175630.827786:0:14349:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789175630.827795:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274216576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789175630.827825:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.827840:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175630.831164:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216576 00000100:00100000:1.0:1789175630.831177:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216576 00000100:00100000:1.0:1789175630.831236:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789175630.831245:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14349:x1876086274216576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789175630.831291:0:14361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789175630.831308:0:14361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789175630.866195:0:14361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789175630.866210:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789175630.867682:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789175630.867691:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789175630.867715:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.867737:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.867745:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.867799:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175630.867813:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 12 pid: 14362 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175630.867830:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274216704:0@lo:104: 00000100:00100000:2.0:1789175630.867907:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175630.867953:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175630.868033:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216704 00000100:00100000:0.0:1789175630.868041:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216704 00000100:00100000:0.0:1789175630.868089:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175630.868098:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274216704:12345-0@lo:104: 00010000:00010000:0.0:1789175630.868120:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868187:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789175630.868194:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274216704:12345-0@lo:104: Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.868202:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789175630.868222:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175630.868228:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868236:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175630.868240:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868249:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789175630.868257:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175630.868264:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175630.868291:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868298:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175630.868319:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868364:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705669000/0x1112cdeac4c176e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176eb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868391:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.868393:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175630.868394:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175630.868418:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71fe837c-1812-4075-866f-5d0b367ca590:3304:1876086274216832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175630.868449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175630.868526:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216832 00000100:00100000:0.0:1789175630.868530:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216832 00010000:00010000:0.0:1789175630.868549:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 13 pid: 14362 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175630.868570:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175630.868577:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+13:3304:x1876086274216832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789175630.868587:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175630.868593:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 13 pid: 14362 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868604:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 13 pid: 14362 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868621:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868629:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789175630.868644:0:14352:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000953290s 00010000:00010000:0.0:1789175630.868648:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868666:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868674:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868681:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868687:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175630.868692:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868700:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868709:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175630.868720:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175630.868752:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+13:3304:x1876086274216832:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.868759:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175630.868888:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71fe837c-1812-4075-866f-5d0b367ca590:3304:1876086274216832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175630.869060:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e705668800/0x1112cdeac4c176eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c176e4 expref: 12 pid: 14362 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175630.869072:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274216704:0@lo:104: 00010000:00010000:1.0:1789175630.869095:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.869104:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.869111:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175630.869117:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72e1b5e00/0x1112cdeac4c1771c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175630.873303:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+11:14349:x1876086274216576:12345-0@lo:253:mount.lustre.0 Request processed in 42044us (45462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175630.873321:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789175630.873599:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:14349:1876086274216576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789175630.873618:0:14349:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789175630.873623:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789175630.873625:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789175630.873627:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175630.873628:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175630.873630:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175630.873631:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175630.873632:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789175630.873634:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789175630.873636:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175630.873637:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789175630.873653:0:14349:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789175630.880305:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789175630.881252:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789175630.882059:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789175630.882230:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789175630.882770:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789175630.882945:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789175630.883921:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789175630.884169:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789175630.884695:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789175630.884931:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789175630.885304:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789175630.885679:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789175630.906493:0:14349:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789175630.907010:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789175630.907313:0:14406:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789175630.907318:0:14406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789175630.907619:0:14407:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789175630.907703:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789175630.910769:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789175630.910912:0:14349:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175630.914688:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789175630.914780:0:14407:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789175630.914785:0:14407:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1789175630.915208:0:14349:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789175630.915225:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789175630.915634:0:14349:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789175630.917117:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789175630.917920:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789175630.917963:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789175630.920048:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789175630.925096:0:14349:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789175630.952127:0:14349:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789175630.952164:0:14349:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb14d8199f988 00100000:10000000:2.0:1789175630.952173:0:14349:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789175630.953072:0:14349:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789175630.953087:0:14349:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789175630.953101:0:14349:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789175630.953128:0:14349:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789175631.395105:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789175631.848388:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789175632.035105:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789175632.035113:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e73474e000 from 6 10000000:01000000:2.0:1789175632.035119:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789175632.035166:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175632.035180:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175632.035192:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175632.035219:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274216960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789175632.035291:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175632.035335:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70767e780 going to sleep for 11 seconds 00000100:00100000:1.0:1789175632.035537:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274216960 00000100:00100000:1.0:1789175632.035546:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274216960 00000100:00100000:1.0:1789175632.035606:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789175632.035616:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+11:14364:x1876086274216960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175632.035629:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175632.035643:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17723 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175632.035666:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175632.035677:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175632.035687:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175632.035736:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274216960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175632.035743:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789175632.036531:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274216960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175632.036553:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175632.036564:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175632.036630:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789175632.037580:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175632.037625:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175632.037689:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217088 00000100:00100000:1.0:1789175632.037698:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217088 00000100:00100000:1.0:1789175632.037747:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789175632.037755:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789175632.037776:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789175632.037793:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789175632.037796:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789175632.037900:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175632.037908:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789175632.037914:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789175632.038021:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789175632.038031:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175632.038041:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175632.422498:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789175632.868059:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789175633.444265:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175634.465560:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175635.493839:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789175635.761173:0:14649:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789175635.880249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789175635.880256:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789175635.880259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789175635.880262:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789175635.880264:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789175635.880268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789175635.880271:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e726448800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789175635.880285:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97e726448800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175635.880307:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72e3ce300 x1876086274217344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789175635.880365:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274217216:0@lo:400:kworker.0 00000100:00100000:1.0:1789175635.880434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175635.880492:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274217344:0@lo:38:kworker.0 00000100:00100000:1.0:1789175635.880561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175635.880599:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217344 00000100:00100000:1.0:1789175635.880605:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217344 00000100:00100000:1.0:1789175635.880633:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175635.880639:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876086274217344:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789175635.880820:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:1.0:1789175635.880853:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1112cdeac4c17731 00000004:00100000:1.0:1789175635.880867:0:14368:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789175635.880999:0:14368:0:(import.c:65:import_set_state_nolock()) ffff97e70829a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175635.881051:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876086274217344:12345-0@lo:38:kworker.0 Request processed in 411us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175635.881070:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789175635.881205:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e72e3ce300 x1876086274217344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789175635.881222:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789175635.881228:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789175635.881233:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789175635.881235:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e726448800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789175635.881241:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876086274217344:0@lo:38:kworker.0 00000100:00100000:3.0:1789175635.881479:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217216 00000100:00100000:3.0:1789175635.881484:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217216 00000100:00100000:3.0:1789175635.881531:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789175635.881538:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:3305:x1876086274217216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175635.881576:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:3305:x1876086274217216:12345-0@lo:400:kworker.0 Request processed in 39us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175635.881582:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789175635.881796:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274217216:0@lo:400:kworker.0 00010000:00010000:0.0:1789175636.514499:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175637.537464:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175638.570822:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789175638.646014:0:14800:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff35f71070 20000000:00000080:2.0:1789175638.646031:0:14800:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e73c4f6400 uarg=0000000000000000 20000000:01000000:2.0:1789175638.646067:0:14800:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789175638.646074:0:14800:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789175638.646080:0:14800:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789175638.646926:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789175638.647123:0:14800:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789175638.652501:0:14800:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789175638.652535:0:14800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.652552:0:14800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.652560:0:14800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.652602:0:14800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.652626:0:14800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 11 pid: 14362 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175638.652642:0:14800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14800:1876086274217472:0@lo:104: 00000100:00100000:3.0:1789175638.652708:0:14800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175638.652813:0:14800:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc540 going to sleep for 11 seconds 00000100:00100000:2.0:1789175638.652938:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217472 00000100:00100000:2.0:1789175638.652945:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217472 00000100:00100000:2.0:1789175638.653035:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175638.653045:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14800:x1876086274217472:12345-0@lo:104: 00010000:00010000:2.0:1789175638.653057:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175638.653189:0:14800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14800:1876086274217472:0@lo:104: 00010000:00010000:3.0:1789175638.653210:0:14800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175638.653243:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175638.653250:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14800:x1876086274217472:12345-0@lo:104: Request processed in 208us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175638.653257:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789175638.653320:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175638.653328:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.653335:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1789175638.653625:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.653635:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789175638.653642:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175638.653649:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175638.653771:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.653779:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175638.653807:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.653815:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4a00/0x1112cdeac4c176f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c176f9 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.653831:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175638.653899:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175638.653903:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175638.653925:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175638.653936:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274217600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175638.653970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175638.654064:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217600 00000100:00100000:1.0:1789175638.654069:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217600 00010000:00010000:1.0:1789175638.654088:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 12 pid: 14362 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175638.654120:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175638.654128:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+12:3307:x1876086274217600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175638.654139:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175638.654144:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 12 pid: 14362 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654167:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 12 pid: 14362 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654181:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654a600/0x1112cdeac4c176f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c176f2 expref: 12 pid: 14362 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654194:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654202:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654215:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654222:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654229:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654235:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654239:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175638.654243:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654250:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654273:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175638.654282:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175638.654313:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+11:3307:x1876086274217600:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175638.654319:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175638.654379:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274217600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175638.654501:0:14800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.654520:0:14800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175638.654526:0:14800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f9c00/0x1112cdeac4c17738 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175639.609599:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789175639.777417:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175639.777425:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73474e000 from 10 10000000:01000000:0.0:1789175639.777431:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175639.777478:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175639.777492:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175639.777504:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175639.777535:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175639.777618:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175639.777699:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789175639.777749:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217728 00000100:00100000:1.0:1789175639.777758:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217728 00000100:00100000:1.0:1789175639.777819:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789175639.777829:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+11:14364:x1876086274217728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175639.777846:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175639.777860:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1773f expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175639.777884:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175639.777895:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175639.777904:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a800, rc 0) 00000100:00100000:1.0:1789175639.777957:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175639.777964:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789175639.778101:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175639.778116:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175639.778125:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175639.778189:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175639.778213:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175639.778235:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175639.778286:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217856 00000100:00100000:2.0:1789175639.778291:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217856 00000100:00100000:2.0:1789175639.778321:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789175639.778328:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789175639.778615:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175639.778622:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789175639.778896:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175639.778925:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175639.778962:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175639.778994:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3000 going to sleep for 11 seconds 00000100:00100000:2.0:1789175639.779048:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274217984 00000100:00100000:2.0:1789175639.779053:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274217984 00000100:00100000:2.0:1789175639.779083:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789175639.779091:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175639.779248:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:14364:x1876086274217984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175639.779255:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789175639.779291:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274217984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789175639.779993:0:14832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789175639.780053:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789175639.780071:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175639.780080:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175639.780101:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175640.612653:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175640.993611:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175630/real 1789175630] req@ffff97e60365df80 x1876086274214656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175640.993644:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e60365df80 x1876086274214656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175640.993656:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175630/real 1789175630] req@ffff97e72e3cf100 x1876086274214528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175640.993688:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e72e3cf100 x1876086274214528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789175640.993728:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1789175640.994012:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274218112:0@lo:400:kworker.0 00000100:00100000:1.0:1789175640.994096:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175640.994207:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274218112 00000100:00100000:2.0:1789175640.994216:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274218112 00000100:00100000:2.0:1789175640.994276:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789175640.994286:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:3307:x1876086274218112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789175640.994376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175640.994381:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789175640.994384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175640.994387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789175640.994389:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789175640.994393:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1789175640.994398:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789175640.994403:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e737ce4000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1789175640.994425:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e603909c00 x1876086274218240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789175640.994467:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274218368:0@lo:400:kworker.0 00000100:00100000:3.0:1789175640.994498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175640.994532:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274218368 00000100:00100000:3.0:1789175640.994536:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274218368 00000100:00100000:3.0:1789175640.994563:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175640.994570:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274218368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175640.994619:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274218368:12345-0@lo:400:kworker.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175640.994635:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789175640.994694:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e60390a680 x1876086274218368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175640.994705:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274218368:0@lo:400:kworker.0 00000100:00080000:0.0:1789175640.995044:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789175640.995050:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274214656:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789175640.995065:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e7267e5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175640.995070:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789175640.995073:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274214528:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789175640.995092:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274218240:0@lo:8:kworker.0 00000400:00000100:0.0:1789175640.995122:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086274218240 offset 0 length 520: 4 00000100:00080000:3.0:1789175640.995262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175640.995266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789175640.995268:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e7267e5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789175640.995271:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1789175640.995274:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789175640.995278:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97e7267e5000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1789175640.995294:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60390a680 x1876086274218496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789175640.995369:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274218496:0@lo:8:kworker.0 00000400:00000100:0.0:1789175640.995407:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086274218496 offset 0 length 520: 4 00000100:00100000:2.0:1789175640.995618:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:3307:x1876086274218112:12345-0@lo:400:kworker.0 Request processed in 1333us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175640.995628:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789175640.995987:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274218112:0@lo:400:kworker.0 00010000:00010000:0.0:1789175641.645220:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175642.087080:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789175642.659817:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175643.681637:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789175644.693745:0:15049:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789175644.693750:0:15049:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789175644.693880:0:15049:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e7082ce000 00000020:01000004:3.0:1789175644.693894:0:15049:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789175644.693907:0:15049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789175644.693921:0:15049:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97e726b80000) 00000020:00000080:3.0:1789175644.693935:0:15049:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1789175644.708463:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789175644.736757:0:15049:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789175644.737111:0:15049:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789175644.738996:0:15049:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789175644.739249:0:15049:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789175644.739940:0:15049:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789175644.740307:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:3.0:1789175644.740505:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 545: rc = 0 00100000:10000000:3.0:1789175644.740625:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 545: rc = 0 00100000:10000000:3.0:1789175644.741176:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 293: rc = 0 00100000:10000000:3.0:1789175644.743215:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 293: rc = 0 00100000:10000000:3.0:1789175644.744185:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 293: rc = 0 00100000:10000000:3.0:1789175644.745059:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 293: rc = 0 00100000:10000000:3.0:1789175644.745313:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 293: rc = 0 00100000:10000000:3.0:1789175644.746444:0:15049:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 293: rc = 0 00000020:00000080:3.0:1789175644.747485:0:15049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789175644.747497:0:15049:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789175644.747507:0:15049:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1112cdeac4c17754 00000020:01000004:3.0:1789175644.747515:0:15049:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789175644.747535:0:15049:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789175644.747539:0:15049:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789175644.747545:0:15049:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789175644.747623:0:15049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789175644.747635:0:15049:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97e726b84d40) 00000020:00000080:3.0:1789175644.747644:0:15049:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789175644.759843:0:15049:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175644.760039:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789175644.760047:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789175644.768015:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789175644.768041:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789175644.769290:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789175644.769300:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789175644.775526:0:15049:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789175644.775773:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789175644.775781:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789175644.785728:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789175644.785745:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789175644.832100:0:15049:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789175644.832856:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789175644.832867:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789175644.834647:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789175644.834661:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789175644.841144:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789175644.841168:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789175644.860850:0:15049:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789175644.861070:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789175644.861078:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789175644.864993:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789175644.865016:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789175644.934021:0:15049:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789175644.937895:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789175644.937904:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789175644.952737:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789175644.952762:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789175644.955337:0:15049:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789175644.955388:0:15049:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789175644.955395:0:15049:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789175644.985181:0:15049:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789175644.985221:0:15049:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789175644.985226:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789175644.985228:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789175644.985229:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175644.985230:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175644.985231:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175644.985233:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175644.985234:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175644.985236:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175644.985238:0:15049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175644.985242:0:15049:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789175644.985244:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789175644.985246:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789175644.985247:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175644.985248:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175644.985249:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175644.985250:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175644.985251:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175644.985252:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175644.985253:0:15049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175644.985285:0:15049:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789175644.985307:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789175644.988771:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175644.988845:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175644.991220:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274218624 00000100:00100000:0.0:1789175644.991242:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274218624 00000100:00100000:0.0:1789175644.991315:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789175644.991327:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:15049:x1876086274218624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789175644.991392:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789175644.991396:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789175644.991415:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789175645.010166:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:15049:x1876086274218624:12345-0@lo:253:mount.lustre.0 Request processed in 18830us (21391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175645.010182:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789175645.010703:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789175645.010721:0:15049:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789175645.010725:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789175645.010726:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789175645.010727:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175645.010728:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175645.010730:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175645.010730:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175645.010732:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175645.010734:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175645.010735:0:15049:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789175645.010753:0:15049:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e7082ce000 from lustre-OST0000 10000000:01000000:1.0:1789175645.010779:0:15049:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789175645.010781:0:15049:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789175645.010800:0:15049:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e726674d40 local copy 00010000:00010000:1.0:1789175645.010812:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.011075:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175645.011119:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.011163:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.011212:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274218752 00000100:00100000:2.0:1789175645.011229:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274218752 00000100:00100000:2.0:1789175645.011298:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789175645.011309:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:15049:x1876086274218752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.012054:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+12:15049:x1876086274218752:12345-0@lo:501:mount.lustre.0 Request processed in 743us (932us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789175645.012066:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789175645.012681:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789175645.012701:0:15049:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789175645.015748:0:15049:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789175645.015770:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.015783:0:15049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175645.015948:0:15049:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e7082ce000 10000000:01000000:1.0:1789175645.015953:0:15049:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789175645.015960:0:15049:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97e726674d40 10000000:01000000:1.0:1789175645.015963:0:15049:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789175645.015966:0:15049:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97e726674d40 from 1 10000000:01000000:1.0:1789175645.015969:0:15049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789175645.016008:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.016017:0:15049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.016029:0:15049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.016053:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789175645.016118:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.016247:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175645.021943:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274218880 00000100:00100000:3.0:1789175645.021960:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274218880 00000100:00100000:0.0:1789175645.022155:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789175645.022166:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+12:15049:x1876086274218880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175645.022182:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175645.022202:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668200/0x1112cdeac4c17769 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17762 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.022232:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668200/0x1112cdeac4c17769 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17762 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.022244:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668200/0x1112cdeac4c17769 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17762 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.022254:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668200, rc 0) 00000100:00100000:0.0:1789175645.022377:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+13:15049:x1876086274218880:12345-0@lo:101:mount.lustre.0 Request processed in 212us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175645.022384:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789175645.022695:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274218880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175645.022717:0:15049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17769 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.022728:0:15049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17769 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175645.022770:0:15049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789175645.022803:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17769 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.022812:0:15049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654ae00/0x1112cdeac4c17762 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17769 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789175645.022821:0:15049:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789175645.022827:0:15049:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789175645.022834:0:15049:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789175645.022836:0:15049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789175645.022862:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.022871:0:15049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.022880:0:15049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.022899:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789175645.022936:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.022975:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175645.023099:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219008 00000100:00100000:3.0:1789175645.023105:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219008 00000100:00100000:3.0:1789175645.023143:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789175645.023152:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+13:15049:x1876086274219008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175645.023161:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175645.023172:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f9000/0x1112cdeac4c17777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17770 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.023190:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f9000/0x1112cdeac4c17777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17770 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.023199:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f9000/0x1112cdeac4c17777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17770 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.023206:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f9000, rc 0) 00000100:00100000:3.0:1789175645.023246:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219008:12345-0@lo:101:mount.lustre.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175645.023253:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789175645.024471:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175645.024493:0:15049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17777 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.024504:0:15049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17777 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789175645.027891:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789175645.028936:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789175645.029202:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789175645.029249:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789175645.029283:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789175645.029333:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789175645.029407:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789175645.029442:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789175645.029524:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789175645.029532:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789175645.031708:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175645.031916:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.031964:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175645.032042:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219136 00000100:00100000:3.0:1789175645.032049:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219136 00000100:00100000:3.0:1789175645.032140:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789175645.032149:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.032590:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219136:12345-0@lo:501:mount.lustre.0 Request processed in 441us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175645.032598:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789175645.032702:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175645.032739:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789175645.032773:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.035822:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175645.040446:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219264 00000100:00100000:0.0:1789175645.040464:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219264 00000100:00100000:0.0:1789175645.040531:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789175645.040555:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789175645.041140:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219264:12345-0@lo:503:mount.lustre.0 Request processed in 597us (8363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175645.041150:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789175645.044082:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789175645.045315:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789175645.045839:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175645.045923:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.045971:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789175645.046034:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219392 00000100:00100000:0.0:1789175645.046042:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219392 00000100:00100000:0.0:1789175645.046090:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789175645.046099:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789175645.048418:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219392:12345-0@lo:502:mount.lustre.0 Request processed in 2308us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175645.048432:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789175645.054663:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175645.055034:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789175645.055104:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789175645.055154:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789175645.055206:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789175645.055248:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789175645.055283:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789175645.055331:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789175645.055473:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789175645.055508:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789175645.055559:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789175645.055598:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789175645.055660:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789175645.055705:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175645.055776:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.055869:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70761f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175645.059020:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219520 00000100:00100000:3.0:1789175645.059042:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219520 00000100:00100000:3.0:1789175645.059106:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789175645.059116:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175645.063917:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219520:12345-0@lo:502:mount.lustre.0 Request processed in 4793us (8132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.063952:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789175645.064445:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175645.064581:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789175645.064594:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789175645.065809:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789175645.065817:0:15063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789175645.065826:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789175645.065828:0:15063:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789175645.065833:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789175645.065847:0:15063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97e726b83380) 00000020:00000080:3.0:1789175645.065866:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789175645.065870:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789175645.065943:0:15063:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7082ce000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789175645.065950:0:15063:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789175645.065957:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1112cdeac4c17785 00010000:00010000:2.0:1789175645.072201:0:15063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789175645.072874:0:15063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789175645.076627:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789175645.078791:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789175645.078803:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175645.078809:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078811:0:15063:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789175645.078815:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789175645.078817:0:15063:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789175645.078819:0:15063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789175645.078820:0:15063:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789175645.078822:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789175645.078824:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078825:0:15063:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789175645.078828:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175645.078831:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078832:0:15063:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789175645.078835:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789175645.078837:0:15063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789175645.078839:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175645.078841:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078842:0:15063:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789175645.078844:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175645.078846:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078847:0:15063:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789175645.078850:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789175645.078907:0:15063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175645.078911:0:15063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175645.078912:0:15063:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789175645.078916:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789175645.080908:0:15049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789175645.080952:0:15049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789175645.080973:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17777 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.080984:0:15049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654a400/0x1112cdeac4c17770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17777 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175645.080991:0:15049:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7082ce000 from 1 10000000:01000000:2.0:1789175645.080994:0:15049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175645.081036:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.081044:0:15049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.081054:0:15049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175645.081080:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789175645.081148:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175645.081194:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7051006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175645.083673:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219648 00000100:00100000:1.0:1789175645.083686:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219648 00000100:00100000:1.0:1789175645.083817:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789175645.083829:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+14:15049:x1876086274219648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175645.083846:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175645.083864:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1778c expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.083915:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.083927:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.083949:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175645.084032:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274219648:12345-0@lo:101:mount.lustre.0 Request processed in 205us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.084039:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789175645.084131:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175645.084150:0:15049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.084159:0:15049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789175645.084723:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789175645.085284:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175645.085540:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789175645.085584:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789175645.085660:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789175645.085668:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789175645.085731:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.085781:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.098762:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.099946:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219776 00000100:00100000:2.0:1789175645.099959:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219776 00000100:00100000:2.0:1789175645.100012:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789175645.100034:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274219776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175645.104117:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274219776:12345-0@lo:501:mount.lustre.0 Request processed in 4074us (18325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.104135:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789175645.104311:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.104409:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175645.104484:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.104518:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.104831:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274219904 00000100:00100000:2.0:1789175645.104837:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274219904 00000100:00100000:2.0:1789175645.104869:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789175645.104876:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274219904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175645.105063:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274219904:12345-0@lo:503:mount.lustre.0 Request processed in 186us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.105070:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789175645.105263:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274219904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789175645.105938:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789175645.105999:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175645.106044:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.106067:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.106132:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220032 00000100:00100000:2.0:1789175645.106137:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220032 00000100:00100000:2.0:1789175645.106158:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789175645.106164:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274220032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175645.106333:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274220032:12345-0@lo:502:mount.lustre.0 Request processed in 153us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.106364:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789175645.106582:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789175645.106830:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789175645.106878:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789175645.106930:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789175645.106983:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789175645.107020:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789175645.107070:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789175645.107586:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789175645.107639:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789175645.107675:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175645.107731:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.107757:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.108041:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220160 00000100:00100000:2.0:1789175645.108047:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220160 00000100:00100000:2.0:1789175645.108077:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789175645.108084:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274220160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175645.108255:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274220160:12345-0@lo:502:mount.lustre.0 Request processed in 170us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.108262:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789175645.108567:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789175645.108703:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789175645.108713:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789175645.110772:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175645.110791:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110794:0:15067:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789175645.110800:0:15067:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7082ce000 00000020:00000080:2.0:1789175645.110803:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789175645.110811:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175645.110813:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110814:0:15067:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789175645.110817:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175645.110819:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110821:0:15067:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789175645.110824:0:15067:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7082ce000 00000020:00000080:2.0:1789175645.110826:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789175645.110885:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175645.110889:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110891:0:15067:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789175645.110893:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789175645.110896:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110897:0:15067:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789175645.110900:0:15067:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e7082ce000 00000020:00000080:2.0:1789175645.110902:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789175645.110941:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789175645.110944:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175645.110945:0:15067:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789175645.110949:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789175645.111966:0:15049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789175645.111995:0:15049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175645.112011:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.112039:0:15049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175645.112088:0:15049:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789175645.112091:0:15049:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e7082ce000 10000000:01000000:3.0:1789175645.112094:0:15049:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e7082ce000 10000000:01000000:3.0:1789175645.112098:0:15049:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789175645.112114:0:15049:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7082ce000 from 1 10000000:01000000:3.0:1789175645.112117:0:15049:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789175645.112154:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.112162:0:15049:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.112172:0:15049:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175645.112197:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789175645.112263:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.115728:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175645.123100:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220288 00000100:00100000:1.0:1789175645.123118:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220288 00000100:00100000:1.0:1789175645.123195:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789175645.123208:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274220288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789175645.123229:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175645.123253:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654be00/0x1112cdeac4c177a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c1779a expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.123284:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654be00/0x1112cdeac4c177a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c1779a expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.123297:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654be00/0x1112cdeac4c177a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1779a expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.123306:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654be00, rc 0) 00000100:00100000:1.0:1789175645.123620:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220288:12345-0@lo:101:mount.lustre.0 Request processed in 412us (11354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.123627:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789175645.126753:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175645.126783:0:15049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177a1 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175645.126796:0:15049:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c177a1 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789175645.129940:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789175645.132614:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789175645.132946:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789175645.132994:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789175645.133029:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789175645.133079:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789175645.133115:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789175645.133165:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789175645.133200:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789175645.133258:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789175645.133308:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789175645.139777:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789175645.139832:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789175645.139901:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789175645.139930:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789175645.139955:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789175645.140015:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789175645.140053:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789175645.140084:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789175645.140126:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789175645.140164:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789175645.140197:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789175645.140259:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789175645.140298:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789175645.140332:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789175645.140424:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789175645.140459:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789175645.140491:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789175645.140537:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789175645.140571:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789175645.150908:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789175645.150937:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789175645.151048:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.151114:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.151159:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.159188:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220416 00000100:00100000:2.0:1789175645.159204:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220416 00000100:00100000:2.0:1789175645.159281:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789175645.159293:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175645.159650:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220416:12345-0@lo:501:mount.lustre.0 Request processed in 357us (8534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.159660:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789175645.159792:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175645.159843:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175645.159888:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.159924:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.159973:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220544 00000100:00100000:2.0:1789175645.159984:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220544 00000100:00100000:2.0:1789175645.160047:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789175645.160054:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175645.160194:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220544:12345-0@lo:503:mount.lustre.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.160201:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789175645.162468:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789175645.163051:0:15049:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789175645.163130:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175645.163203:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175645.163249:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220672 00000100:00100000:3.0:1789175645.163255:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220672 00000100:00100000:3.0:1789175645.163290:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789175645.163299:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175645.164113:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220672:12345-0@lo:502:mount.lustre.0 Request processed in 811us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175645.164122:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789175645.164174:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1789175645.164194:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789175645.166139:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789175645.166218:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789175645.166254:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789175645.166318:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789175645.166377:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789175645.166430:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789175645.166483:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789175645.166518:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789175645.166566:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789175645.166617:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789175645.166655:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789175645.166706:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789175645.166747:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789175645.166784:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789175645.166834:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789175645.166873:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789175645.166910:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789175645.166961:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789175645.166998:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789175645.167037:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789175645.167088:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789175645.167127:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789175645.167182:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789175645.167236:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789175645.167276:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789175645.167311:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789175645.167390:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789175645.167432:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789175645.167470:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789175645.167545:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789175645.167588:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789175645.167638:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789175645.167672:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789175645.167722:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789175645.167760:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789175645.167810:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789175645.167856:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789175645.167888:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789175645.167951:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789175645.167987:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789175645.168039:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789175645.168116:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175645.168165:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e6037ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789175645.168820:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220800 00000100:00100000:2.0:1789175645.168829:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220800 00000100:00100000:2.0:1789175645.168877:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789175645.168886:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175645.169127:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274220800:12345-0@lo:502:mount.lustre.0 Request processed in 241us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175645.169135:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789175645.171416:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274220800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175645.172684:0:15049:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789175645.172705:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789175645.176302:0:15072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789175645.176321:0:15072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97e70707cd40) 00000020:00000080:1.0:1789175645.176451:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789175645.176690:0:15072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7082ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789175645.176695:0:15072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7082ce000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789175645.176698:0:15072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7082ce000 3 00010000:00080000:1.0:1789175645.176781:0:15072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e603a6b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1789175645.179046:0:15072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789175645.179276:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789175645.179312:0:15072:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789175645.179323:0:15072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1112cdeac4c177af 00000100:00080000:1.0:1789175645.179333:0:15072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789175645.179367:0:15072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97e603a6b800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1789175645.179411:0:15072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e72e3cc380 x1876086274220928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789175645.179439:0:15072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789175645.179524:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274220928:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789175645.179607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.179844:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274220928 00000100:00100000:1.0:1789175645.179852:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274220928 00000100:00100000:1.0:1789175645.179886:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175645.179893:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876086274220928:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789175645.179915:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1789175645.179950:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1112cdeac4c177b6 00000004:00100000:1.0:1789175645.179963:0:14368:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789175645.179992:0:14368:0:(import.c:65:import_set_state_nolock()) ffff97e603a6d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789175645.180039:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876086274220928:12345-0@lo:38:llog_process_th.0 Request processed in 145us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.180047:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789175645.180079:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e72e3cc380 x1876086274220928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175645.180089:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789175645.180101:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789175645.180107:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789175645.180111:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789175645.180113:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e603a6b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789175645.180118:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1876086274220928:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789175645.180235:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1789175645.180396:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789175645.180401:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789175645.180404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789175645.180407:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789175645.180443:0:15049:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789175645.180468:0:15049:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789175645.180481:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177a1 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.180491:0:15049:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f9c00/0x1112cdeac4c1779a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177a1 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789175645.180530:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789175645.180534:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789175645.180536:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1789175645.180647:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274221056:0@lo:400:kworker.0 00000100:00100000:1.0:1789175645.180681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.180715:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221056 00000100:00100000:1.0:1789175645.180719:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221056 00000100:00100000:1.0:1789175645.180747:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175645.180755:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274221056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175645.180796:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274221056:12345-0@lo:400:kworker.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.180801:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789175645.180828:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97e60365c380 x1876086274221056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789175645.180837:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274221056:0@lo:400:kworker.0 00000020:01000004:2.0:1789175645.180883:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175645.180886:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175645.180887:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175645.180888:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175645.180890:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175645.180891:0:15049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789175645.180895:0:15049:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789175645.180897:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789175645.180898:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789175645.180899:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175645.180900:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175645.180900:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175645.180901:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175645.180902:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175645.180903:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175645.180904:0:15049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789175645.180922:0:15049:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789175645.180934:0:15049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274221184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789175645.180967:0:15049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175645.180995:0:15049:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e702e23480 going to sleep for 11 seconds 00000100:00100000:1.0:1789175645.181049:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221184 00000100:00100000:1.0:1789175645.181054:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221184 00000100:00100000:1.0:1789175645.181085:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789175645.181091:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:15049:x1876086274221184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789175645.181110:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789175645.181123:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789175645.220656:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789175645.220680:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789175645.220753:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789175645.220757:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789175645.220780:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.220800:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.220819:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.220858:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.220883:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 16 pid: 14362 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175645.220897:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274221312:0@lo:104: 00000100:00100000:2.0:1789175645.220956:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175645.220999:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e72f49ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175645.221078:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221312 00000100:00100000:0.0:1789175645.221094:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221312 00000100:00100000:0.0:1789175645.221166:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175645.221183:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274221312:12345-0@lo:104: 00010000:00010000:0.0:1789175645.221203:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221323:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789175645.221331:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274221312:12345-0@lo:104: Request processed in 155us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175645.221374:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789175645.221417:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175645.221425:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221435:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1789175645.221440:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221450:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.221675:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274221312:0@lo:104: 10000000:00010000:0.0:1789175645.221692:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.221698:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175645.221700:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789175645.221861:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221870:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789175645.221912:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221920:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5e00/0x1112cdeac4c17723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c1772a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175645.221940:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175645.221942:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175645.221944:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175645.222081:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274221440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175645.222131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175645.222204:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221440 00000100:00100000:1.0:1789175645.222210:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221440 00010000:00010000:1.0:1789175645.222237:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 17 pid: 14362 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.222274:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175645.222285:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+17:3306:x1876086274221440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175645.222298:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175645.222304:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 17 pid: 14362 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222319:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 17 pid: 14362 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222388:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c1772a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c17723 expref: 17 pid: 14362 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222406:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222416:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789175645.222814:0:14352:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002055732s 00010000:00010000:1.0:1789175645.222829:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222838:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222845:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222852:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222857:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175645.222863:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222871:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222894:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175645.222905:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175645.222950:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+16:3306:x1876086274221440:12345-0@lo:103:ldlm_bl.0 Request processed in 669us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.222958:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789175645.223147:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274221440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175645.224209:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.224224:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175645.224231:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72e1b5600/0x1112cdeac4c177bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175645.258805:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+15:15049:x1876086274221184:12345-0@lo:253:mount.lustre.0 Request processed in 77703us (77825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175645.258821:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789175645.258843:0:15049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15049:1876086274221184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789175645.258859:0:15049:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789175645.258862:0:15049:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789175645.258864:0:15049:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789175645.258865:0:15049:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175645.258867:0:15049:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175645.258868:0:15049:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175645.258869:0:15049:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175645.258871:0:15049:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175645.258872:0:15049:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175645.258874:0:15049:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789175645.258887:0:15049:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789175645.265746:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175645.265950:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175645.266127:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175645.266330:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175645.266501:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175645.266741:0:15049:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789175645.268111:0:15049:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789175645.358752:0:15049:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789175645.358760:0:15049:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789175645.358791:0:15049:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789175645.358853:0:15049:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789175645.358867:0:15049:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789175645.358895:0:15049:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789175645.730523:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789175646.626164:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789175646.626172:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e73474e000 from 7 10000000:01000000:3.0:1789175646.626177:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789175646.626224:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626236:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626248:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175646.626274:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274221568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175646.626372:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175646.626419:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789175646.626441:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221568 00000100:00100000:3.0:1789175646.626447:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221568 00000100:00100000:3.0:1789175646.626493:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789175646.626502:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+15:14364:x1876086274221568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175646.626515:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175646.626529:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c177c4 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626552:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626563:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626580:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e7050f8a00, rc 0) 00000100:00100000:3.0:1789175646.626632:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:14364:x1876086274221568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175646.626639:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789175646.626897:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274221568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789175646.626911:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175646.626920:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175646.626967:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274221696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789175646.626998:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175646.627151:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7082c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789175646.639032:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221696 00000100:00100000:0.0:1789175646.639048:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221696 00000100:00100000:1.0:1789175646.657421:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175646.657437:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:14364:x1876086274221696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789175646.657478:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789175646.657495:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789175646.657518:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789175646.657697:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:14364:x1876086274221696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 264us (30697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175646.657717:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789175646.657763:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274221696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789175646.657834:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789175646.657845:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175646.657856:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175646.753876:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175647.784769:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175648.802701:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175649.830067:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175650.216859:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274221824:0@lo:400:kworker.0 00000100:00100000:1.0:1789175650.216962:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789175650.217130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789175650.217136:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789175650.217150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789175650.217154:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789175650.217218:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274221952:0@lo:400:kworker.0 00000100:00100000:0.0:1789175650.217263:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175650.217301:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789175650.217308:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274222080:0@lo:400:kworker.0 00000100:00100000:0.0:1789175650.217334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175650.217398:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221952 00000100:00100000:0.0:1789175650.217406:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221952 00000100:00100000:3.0:1789175650.219264:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274221824 00000100:00100000:3.0:1789175650.219283:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274221824 00000100:00100000:3.0:1789175650.219386:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789175650.219399:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:3307:x1876086274221824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175650.220114:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222080 00000100:00100000:0.0:1789175650.220121:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222080 00000100:00100000:0.0:1789175650.220175:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175650.220184:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175650.220280:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274221952:12345-0@lo:400:kworker.0 Request processed in 98us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175650.220287:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175650.220306:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175650.220312:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175650.220358:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274222080:12345-0@lo:400:kworker.0 Request processed in 47us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175650.220363:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789175650.220422:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e72643ed80 x1876086274222080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175650.220453:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274222080:0@lo:400:kworker.0 00010000:00080000:0.0:1789175650.220469:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e72643d180 x1876086274221952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175650.220490:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274221952:0@lo:400:kworker.0 00000100:00100000:3.0:1789175650.220729:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:3307:x1876086274221824:12345-0@lo:400:kworker.0 Request processed in 1331us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175650.220737:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789175650.220788:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274221824:0@lo:400:kworker.0 00000100:00080000:1.0:1789175650.220907:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789175650.849601:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175651.877646:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789175651.889196:0:15419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1789175652.322379:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789175652.900928:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175653.922902:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175654.947394:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175655.341077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175655.341086:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789175655.341089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175655.341099:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789175655.341170:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274222336:0@lo:400:kworker.0 00000100:00100000:3.0:1789175655.341268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175655.341337:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175655.341364:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274222208:0@lo:400:kworker.0 00000100:00100000:3.0:1789175655.341399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175655.341454:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222208 00000100:00100000:3.0:1789175655.341464:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222208 00000100:00100000:3.0:1789175655.341518:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789175655.341528:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:3307:x1876086274222208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175655.341589:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:3307:x1876086274222208:12345-0@lo:400:kworker.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175655.341596:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789175655.341652:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274222208:0@lo:400:kworker.0 00000100:00100000:0.0:1789175655.342457:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274222464:0@lo:400:kworker.0 00000100:00100000:0.0:1789175655.342507:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175655.342607:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222336 00000100:00100000:0.0:1789175655.342612:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222336 00000100:00100000:0.0:1789175655.342652:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222464 00000100:00100000:0.0:1789175655.342655:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222464 00000100:00100000:0.0:1789175655.342693:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789175655.342700:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175655.342766:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876086274222336:12345-0@lo:400:kworker.0 Request processed in 66us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175655.342773:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175655.343177:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175655.343190:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274222464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175655.343240:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274222464:12345-0@lo:400:kworker.0 Request processed in 55us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175655.343247:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789175655.343621:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789175655.344089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e603909f80 x1876086274222464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.344108:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274222464:0@lo:400:kworker.0 00010000:00080000:0.0:1789175655.344150:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e60390ad80 x1876086274222336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.344160:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876086274222336:0@lo:400:kworker.0 00000100:00100000:0.0:1789175655.458116:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175640/real 1789175640] req@ffff97e60390a680 x1876086274218496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.458157:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e60390a680 x1876086274218496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.458181:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789175640/real 1789175640] req@ffff97e603909c00 x1876086274218240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175655 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.458194:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97e603909c00 x1876086274218240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789175655 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789175655.458216:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e7267e5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175655.458244:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789175655.458249:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274218496:0@lo:8:kworker.0 00000100:00080000:0.0:1789175655.458256:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175655.458261:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789175655.458264:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274218240:0@lo:8:kworker.0 00000100:00080000:3.0:1789175655.458335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175655.458372:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789175655.458376:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e7267e5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789175655.458382:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1789175655.458389:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789175655.458396:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97e7267e5000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1789175655.458446:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e603908000 x1876086274222592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789175655.458468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175655.458472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789175655.458479:0:36:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789175655.458483:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1789175655.458486:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789175655.458490:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e737ce4000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1789175655.458505:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e603909c00 x1876086274222720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789175655.458607:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274222592:0@lo:8:kworker.0 00000100:00100000:0.0:1789175655.458704:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175655.458777:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274222720:0@lo:8:kworker.0 00000100:00100000:3.0:1789175655.459027:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222592 00000100:00100000:3.0:1789175655.459037:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222592 00000100:00100000:3.0:1789175655.459084:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175655.459092:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876086274222592:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789175655.459124:0:15050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1789175655.459158:0:15050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c177d2 00002000:00100000:3.0:1789175655.459176:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97e7030e5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789175655.459180:0:15050:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789175655.459183:0:15050:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789175655.459650:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789175655.459693:0:15050:0:(import.c:65:import_set_state_nolock()) ffff97e7030e7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789175655.459774:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876086274222592:12345-0@lo:8:kworker.0 Request processed in 680us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175655.459794:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175655.460244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789175655.460325:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e603908000 x1876086274222592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789175675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.460337:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789175655.460367:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789175655.460377:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789175655.460384:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789175655.460387:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e7267e5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789175655.460411:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789175655.460427:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274222592:0@lo:8:kworker.0 00000004:00080000:2.0:1789175655.460832:0:14390:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789175655.460858:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1876086274222976:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789175655.460898:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175655.460918:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265accc0 going to sleep for 11 seconds 00000004:00080000:2.0:1789175655.460935:0:14389:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789175655.461285:0:14389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440419942623ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789175655.461325:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222720 00000100:00100000:2.0:1789175655.461333:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222720 00000100:00100000:2.0:1789175655.461642:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222976 00000100:00100000:2.0:1789175655.461647:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222976 00000100:00100000:2.0:1789175655.461694:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175655.461702:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876086274222720:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789175655.461724:0:15051:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789175655.461784:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876086274222720:12345-0@lo:8:kworker.0 Request processed in 81us (1540us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789175655.461792:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175655.461822:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789175655.461828:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14390:x1876086274222976:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789175655.463736:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274222848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175655.463822:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789175655.463929:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789175655.463935:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789175655.463939:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274222720:0@lo:8:kworker.0 00000100:00100000:3.0:1789175655.472751:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274222848 00000100:00100000:3.0:1789175655.472774:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274222848 00000100:00100000:3.0:1789175655.472864:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175655.472877:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876086274222848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175655.472926:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175655.473034:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876086274222848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (9210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175655.473053:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789175655.473084:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789175655.475182:0:15051:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789175655.475195:0:15051:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789175655.475201:0:15051:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:0.0:1789175655.476463:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e60365d880 x1876086274222848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175655.476500:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274222848:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1789175655.526886:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.526904:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.526926:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.526932:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.526940:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.526961:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.526975:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.526984:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.527018:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175655.527054:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175655.527070:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.527084:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175655.527089:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.527114:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.527141:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.527150:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c656e1/0x1112cdeac4c177d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.527184:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.527198:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.527200:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.528731:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.528743:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528762:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.528767:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.528781:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528797:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528807:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528814:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528839:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175655.528855:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175655.528862:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528870:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175655.528875:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528884:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528901:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528921:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.528938:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.528940:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.528942:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.537041:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.541180:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.541205:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.541211:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.541220:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.541240:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.541253:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.541261:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.541303:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175655.541382:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175655.541408:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.541449:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175655.541454:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.541474:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.541497:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.541505:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c86fa5/0x1112cdeac4c177e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.541535:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.541538:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.541552:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.542133:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.542148:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.542161:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.542164:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.542170:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.542181:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.542190:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.542197:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.542222:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175655.542287:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175655.542298:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.542309:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175655.542316:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.542326:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.542389:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.542656:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a56455f/0x1112cdeac4c177ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.542678:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.542681:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.542683:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.552132:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.552157:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552181:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.552187:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.552195:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552214:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552247:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552254:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552277:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175655.552298:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175655.552306:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552315:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175655.552321:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.552333:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.554629:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.554651:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006386534b/0x1112cdeac4c177f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.554684:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.554701:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.554705:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.562232:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.562250:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.562274:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.562280:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.562288:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.562306:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.562317:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.562325:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.562578:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789175655.562661:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175655.562671:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.562683:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.562701:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.562717:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.562741:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.562747:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092589ec7/0x1112cdeac4c177fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.562765:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.562766:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.562768:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789175655.563147:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.563154:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.563168:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.563171:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.563177:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.563196:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.563205:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.563213:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.563769:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789175655.564323:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789175655.564331:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.564654:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789175655.564658:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175655.564665:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.564679:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.564691:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.564713:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789175655.564929:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789175655.572090:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789175655.572108:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573322:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.573329:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573372:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573397:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573431:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007781dd20/0x1112cdeac4c17803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573527:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175655.573532:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573540:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.573543:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573551:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573561:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.573569:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.573571:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.573573:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.575048:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789175655.575068:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035afdb25/0x1112cdeac4c1780a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.575084:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.575989:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.576001:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.576018:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.576023:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.576030:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.576046:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.576057:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.576065:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.580050:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789175655.580198:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175655.580209:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.580227:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.580251:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.580263:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.580287:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.580295:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9781a1c/0x1112cdeac4c17811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.580324:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.580327:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.580329:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.583704:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.583728:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.583745:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.583750:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.583757:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.583772:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.583783:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.583792:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.583821:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175655.586443:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.586463:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.586480:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.586486:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.586501:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.586538:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.586546:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eb35ef9/0x1112cdeac4c17818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.586617:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.586619:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.586621:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.587118:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.587133:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.587153:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.587166:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.587173:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589070:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589103:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589111:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589140:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789175655.589845:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.589852:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589865:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.589869:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.589876:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589888:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589898:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.589912:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.590522:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789175655.591040:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.591047:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.591059:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.591063:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.591068:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.591078:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.591087:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.591107:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.591116:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789175655.591315:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789175655.591325:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591333:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.591338:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591362:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591380:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591405:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000567a76f4/0x1112cdeac4c1781f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591435:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789175655.591439:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591445:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.591448:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591455:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591466:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591473:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083661599/0x1112cdeac4c17826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591486:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175655.591489:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591495:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175655.591506:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591513:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591522:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591529:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006612141f/0x1112cdeac4c1782d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175655.591540:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.591542:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175655.591543:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.592532:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.595016:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.595029:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.595050:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.595055:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.595062:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.595076:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.595087:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.595095:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.595122:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789175655.596095:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175655.596104:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.596115:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175655.596120:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.596129:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.596147:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.596155:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e143fbd8/0x1112cdeac4c17834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175655.596203:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.596205:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.596207:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.600056:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.600069:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600086:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.600091:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.600097:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600112:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600135:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600143:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600169:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789175655.600676:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.600683:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600693:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.600697:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.600701:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600710:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600718:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600724:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.600755:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789175655.601131:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.601138:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601147:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.601151:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.601155:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601165:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601174:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601181:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601189:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789175655.601638:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.601644:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601652:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.601660:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.601665:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601674:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601682:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601690:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.601697:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789175655.602062:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.602070:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602078:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.602080:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.602085:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602094:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602102:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602115:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602124:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1789175655.602381:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789175655.602398:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602412:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602429:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602443:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602470:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602479:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8320b76/0x1112cdeac4c1783b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602522:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789175655.602526:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602534:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602554:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602562:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602577:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602585:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af9f176e/0x1112cdeac4c17842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175655.602587:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.602604:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602613:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789175655.602616:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1789175655.602620:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602622:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.602638:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602643:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602651:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602662:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602665:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602700:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602707:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602711:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602731:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027b668b7/0x1112cdeac4c17849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.602737:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789175655.602759:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789175655.602764:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602770:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602774:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602782:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602792:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602799:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007657ffc8/0x1112cdeac4c17850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602813:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175655.602817:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602823:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f8400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602826:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602844:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602854:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602861:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee38dcef/0x1112cdeac4c17857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602874:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.602877:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602884:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.602887:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602894:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602903:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.602911:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.602912:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.602920:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.603359:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175655.609512:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008785898d/0x1112cdeac4c1785e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789175655.610162:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.610170:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610194:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.610200:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.610206:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610223:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610233:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610241:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610266:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175655.610397:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.610423:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.610439:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.610446:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.610460:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.610487:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.610496:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.610531:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.610534:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.610536:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.610750:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.610757:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610766:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.610769:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.610780:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610789:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610797:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610804:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.610822:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789175655.611199:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.611204:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611212:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.611215:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.611219:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611228:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611237:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611255:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611275:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175655.611318:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175655.611326:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611337:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.611364:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611398:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611415:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611436:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028105fea/0x1112cdeac4c1786c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611465:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.611469:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611477:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.611482:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611491:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611504:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611512:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004405730e/0x1112cdeac4c17873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611548:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.611552:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.611554:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.611758:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.611765:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611774:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.611777:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.611781:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611790:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611798:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611805:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.611824:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175655.611881:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.611889:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611898:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.611902:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611911:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611923:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611932:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012504aab/0x1112cdeac4c1787a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.611967:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.611970:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.611973:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.612214:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.612221:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.612237:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.612239:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.612244:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.612252:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.612261:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.612268:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.612287:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175655.612405:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.612413:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.612444:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.612448:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.612457:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.612469:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.612476:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e94c7a/0x1112cdeac4c17881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.612495:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.612497:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.612498:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175655.612724:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.627682:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.627695:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.627724:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.627730:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.627737:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.627752:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.627774:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.627781:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.627799:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175655.629241:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.629253:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.629267:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.629273:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.629285:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.629313:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.629320:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000946f13a0/0x1112cdeac4c17888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.629371:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.629374:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.629376:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789175655.630424:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789175655.630435:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.630450:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789175655.630454:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175655.630605:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.630621:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.630631:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.630638:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175655.630672:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789175655.630915:0:15051:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1789175655.631143:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14390:x1876086274222976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 169310us (170240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175655.631154:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789175655.631375:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175655.631382:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.631399:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175655.631403:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.631412:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.631436:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.631443:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d520b758/0x1112cdeac4c1788f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175655.631489:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.631491:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175655.631493:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175655.631702:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1876086274222976:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789175655.631997:0:14390:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789175655.632043:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1876086274223104:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789175655.632082:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175655.632239:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7075a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789175655.637176:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223104 00000100:00100000:2.0:1789175655.637204:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223104 00000100:00100000:2.0:1789175655.637268:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175655.637279:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14390:x1876086274223104:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789175655.637329:0:15052:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789175655.669414:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14390:x1876086274223104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32115us (37309us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789175655.669437:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175655.669901:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1876086274223104:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789175655.669928:0:14390:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1789175655.980062:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175656.059287:0:6713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789175656.059441:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789175656.993534:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175658.022466:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175659.042706:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175660.067022:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789175660.191713:0:15771:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789175660.191717:0:15771:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789175660.191861:0:15771:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97e7030e5800 00000020:01000004:3.0:1789175660.191882:0:15771:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789175660.191898:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789175660.191916:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97e726b819c0) 00000020:00000080:3.0:1789175660.191936:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789175660.231094:0:15771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789175660.231677:0:15771:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789175660.232386:0:15771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789175660.232617:0:15771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789175660.232824:0:15771:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789175660.233206:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 511: rc = 0 00100000:10000000:2.0:1789175660.233415:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 511: rc = 0 00100000:10000000:2.0:1789175660.233510:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 511: rc = 0 00100000:10000000:2.0:1789175660.234048:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1789175660.235897:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1789175660.236568:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1789175660.236860:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1789175660.237140:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1789175660.237874:0:15771:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:2.0:1789175660.239012:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789175660.239030:0:15771:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789175660.239046:0:15771:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1112cdeac4c1789d 00000020:01000004:2.0:1789175660.239057:0:15771:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789175660.239086:0:15771:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789175660.239091:0:15771:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789175660.239097:0:15771:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789175660.239125:0:15771:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789175660.239130:0:15771:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789175660.263793:0:15771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789175660.263848:0:15771:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789175660.263853:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789175660.263855:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789175660.263856:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175660.263857:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175660.263858:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175660.263859:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175660.263860:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175660.263862:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175660.263863:0:15771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175660.263867:0:15771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789175660.263876:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789175660.263877:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789175660.263921:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789175660.263923:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789175660.263923:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789175660.263924:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789175660.263925:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789175660.263926:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789175660.263926:0:15771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789175660.263950:0:15771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789175660.263969:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789175660.264039:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175660.264088:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7054f5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789175660.264198:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223232 00000100:00100000:2.0:1789175660.264330:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223232 00000100:00100000:2.0:1789175660.264813:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789175660.264828:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15771:x1876086274223232:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789175660.264871:0:14360:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789175660.264875:0:14360:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789175660.264880:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789175660.285661:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789175660.285684:0:15771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789175660.285687:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789175660.285688:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789175660.285689:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175660.285690:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175660.285691:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175660.285692:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175660.285693:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175660.285694:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175660.285695:0:15771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789175660.285719:0:15771:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97e7030e5800 from lustre-OST0001 10000000:01000000:2.0:1789175660.285764:0:15771:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789175660.285782:0:15771:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789175660.285791:0:15771:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97e726674d40 local copy 00010000:00010000:2.0:1789175660.285801:0:15771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175660.285994:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175660.286031:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.286099:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e6019263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.286604:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:15771:x1876086274223232:12345-0@lo:253:mount.lustre.0 Request processed in 20674us (21458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.286616:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789175660.286646:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223360 00000100:00100000:3.0:1789175660.286651:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223360 00000100:00100000:1.0:1789175660.290960:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789175660.290986:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:15771:x1876086274223360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175660.291244:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:15771:x1876086274223360:12345-0@lo:501:mount.lustre.0 Request processed in 272us (5214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789175660.291251:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789175660.291396:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223360:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789175660.291421:0:15771:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789175660.291600:0:15771:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789175660.291608:0:15771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.291616:0:15771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72654b800/0x1112cdeac4c1764a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17651 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175660.291635:0:15771:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97e7030e5800 10000000:01000000:2.0:1789175660.291639:0:15771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789175660.291643:0:15771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789175660.291644:0:15771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789175660.291648:0:15771:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789175660.291650:0:15771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789175660.291673:0:15771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.291678:0:15771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.291693:0:15771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175660.291709:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789175660.291748:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.291789:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e6019263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175660.291970:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223488 00000100:00100000:0.0:1789175660.291977:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223488 00000100:00100000:0.0:1789175660.292018:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789175660.292026:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+16:15771:x1876086274223488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175660.292036:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175660.292048:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705669600/0x1112cdeac4c178ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c178a4 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.292066:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705669600/0x1112cdeac4c178ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c178a4 expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.292074:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705669600/0x1112cdeac4c178ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c178a4 expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.292080:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705669600, rc 0) 00000100:00100000:0.0:1789175660.292113:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223488:12345-0@lo:101:mount.lustre.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175660.292117:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789175660.292175:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789175660.292183:0:15771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ab expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.292189:0:15771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c178ab expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789175660.293292:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789175660.294277:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789175660.295078:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789175660.295111:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789175660.295127:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789175660.295151:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789175660.295169:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789175660.295201:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789175660.295239:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789175660.295244:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789175660.295313:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175660.296606:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.296690:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175660.297711:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223616 00000100:00100000:1.0:1789175660.297720:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223616 00000100:00100000:1.0:1789175660.297889:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789175660.297897:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175660.298254:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223616:12345-0@lo:501:mount.lustre.0 Request processed in 358us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.298259:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789175660.298323:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789175660.298427:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789175660.298481:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.300402:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175660.300626:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223744 00000100:00100000:0.0:1789175660.300633:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223744 00000100:00100000:0.0:1789175660.300671:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789175660.300677:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789175660.318607:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223744:12345-0@lo:503:mount.lustre.0 Request processed in 17921us (20117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175660.318625:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789175660.319791:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789175660.320730:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789175660.320824:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175660.320894:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.320926:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175660.321327:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274223872 00000100:00100000:1.0:1789175660.321366:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274223872 00000100:00100000:1.0:1789175660.321409:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789175660.321418:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.321672:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274223872:12345-0@lo:502:mount.lustre.0 Request processed in 254us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.321681:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789175660.322447:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274223872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789175660.322950:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789175660.323005:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789175660.323040:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789175660.323095:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789175660.323131:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789175660.323163:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789175660.323203:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789175660.323239:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789175660.323284:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789175660.323316:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175660.323419:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.323786:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224000 00000100:00100000:1.0:1789175660.323793:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224000 00000100:00100000:1.0:1789175660.323836:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789175660.323845:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274224000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.324007:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274224000:12345-0@lo:502:mount.lustre.0 Request processed in 163us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.324015:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789175660.324158:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175660.324179:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789175660.324246:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789175660.324256:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789175660.328708:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789175660.328718:0:15772:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789175660.328727:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789175660.328729:0:15772:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789175660.328733:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789175660.328795:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97e73c4f99c0) 00000020:00000080:2.0:1789175660.328816:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789175660.328820:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789175660.328866:0:15772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7030e5800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789175660.328872:0:15772:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789175660.328876:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1112cdeac4c178b9 00010000:00010000:2.0:1789175660.333828:0:15772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789175660.334221:0:15772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789175660.336603:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789175660.340496:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789175660.340518:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.340574:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.340583:0:15772:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789175660.340589:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175660.340593:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.340594:0:15772:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789175660.340596:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789175660.340598:0:15772:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789175660.340600:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.340601:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.340602:0:15772:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789175660.340603:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175660.340604:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.340605:0:15772:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789175660.340607:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789175660.340659:0:15772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.340660:0:15772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.340661:0:15772:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789175660.340663:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789175660.341274:0:15771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789175660.341300:0:15771:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789175660.341360:0:15771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ab expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.341373:0:15771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5c00/0x1112cdeac4c178a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ab expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175660.341381:0:15771:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7030e5800 from 1 10000000:01000000:2.0:1789175660.341385:0:15771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175660.341421:0:15771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.341430:0:15771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.341441:0:15771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175660.341489:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789175660.341573:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.341623:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175660.341773:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224128 00000100:00100000:0.0:1789175660.341779:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224128 00000100:00100000:0.0:1789175660.341821:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789175660.341829:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:15771:x1876086274224128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175660.341841:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175660.341853:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c178c0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.341873:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.341891:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.341898:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e705668400, rc 0) 00000100:00100000:0.0:1789175660.341938:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224128:12345-0@lo:101:mount.lustre.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175660.341943:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789175660.341989:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175660.342002:0:15771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.342009:0:15771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175660.342821:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789175660.343412:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789175660.343661:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789175660.343708:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789175660.343773:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789175660.343780:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789175660.343843:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789175660.343898:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175660.343942:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.344201:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224256 00000100:00100000:3.0:1789175660.344207:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224256 00000100:00100000:3.0:1789175660.344251:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789175660.344258:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789175660.344951:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224256:12345-0@lo:501:mount.lustre.0 Request processed in 692us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.344957:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789175660.345354:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789175660.345398:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789175660.345445:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175660.345482:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175660.346668:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224384 00000100:00100000:2.0:1789175660.346675:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224384 00000100:00100000:0.0:1789175660.346719:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789175660.346731:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789175660.346955:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224384:12345-0@lo:503:mount.lustre.0 Request processed in 227us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175660.346963:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789175660.347463:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789175660.348020:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789175660.348077:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175660.348128:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.348152:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e6019263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.348203:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224512 00000100:00100000:3.0:1789175660.348207:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224512 00000100:00100000:3.0:1789175660.348234:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789175660.348240:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175660.348419:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224512:12345-0@lo:502:mount.lustre.0 Request processed in 178us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.348435:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789175660.348612:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789175660.349040:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789175660.349089:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789175660.349148:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789175660.349180:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789175660.349205:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789175660.349231:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789175660.349260:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789175660.349276:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789175660.349293:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789175660.349322:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.349607:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e6019263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175660.349987:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224640 00000100:00100000:1.0:1789175660.349993:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224640 00000100:00100000:1.0:1789175660.350034:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789175660.350041:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.350197:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224640:12345-0@lo:502:mount.lustre.0 Request processed in 156us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.350213:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789175660.350264:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175660.350705:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789175660.350716:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789175660.354023:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175660.354034:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354036:0:15776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789175660.354043:0:15776:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7030e5800 00000020:00000080:0.0:1789175660.354045:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789175660.354050:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.354052:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354053:0:15776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789175660.354054:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175660.354055:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354056:0:15776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789175660.354058:0:15776:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97e7030e5800 00000020:00000080:0.0:1789175660.354059:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789175660.354105:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.354107:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354108:0:15776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789175660.354110:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789175660.354112:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354113:0:15776:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789175660.354116:0:15776:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97e7030e5800 00000020:00000080:0.0:1789175660.354117:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789175660.354139:0:15776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789175660.354141:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789175660.354142:0:15776:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789175660.354144:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789175660.354222:0:15771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789175660.354248:0:15771:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175660.354272:0:15771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.354297:0:15771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789175660.354369:0:15771:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789175660.354372:0:15771:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97e7030e5800 10000000:01000000:2.0:1789175660.354376:0:15771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97e7030e5800 10000000:01000000:2.0:1789175660.354381:0:15771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789175660.354415:0:15771:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97e7030e5800 from 1 10000000:01000000:0.0:1789175660.354425:0:15771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789175660.354464:0:15771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.354471:0:15771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.354482:0:15771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175660.354511:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789175660.354589:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175660.354632:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224768 00000100:00100000:0.0:1789175660.354638:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.354640:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224768 00000100:00100000:3.0:1789175660.354688:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789175660.354697:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274224768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789175660.354710:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175660.354723:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031800/0x1112cdeac4c178d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c178ce expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.354757:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031800/0x1112cdeac4c178d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c178ce expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.354768:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031800/0x1112cdeac4c178d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c178ce expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.354778:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031800, rc 0) 00000100:00100000:3.0:1789175660.354818:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274224768:12345-0@lo:101:mount.lustre.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.354826:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789175660.354844:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789175660.354857:0:15771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178d5 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175660.354864:0:15771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c178d5 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175660.355697:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789175660.356076:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789175660.356423:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789175660.356473:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789175660.356530:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789175660.356598:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789175660.356650:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789175660.356703:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789175660.356801:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789175660.356836:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789175660.356914:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789175660.356951:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789175660.356988:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789175660.357032:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789175660.357065:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789175660.357094:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789175660.357183:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789175660.357249:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789175660.357305:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789175660.357416:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789175660.357451:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789175660.357481:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789175660.357526:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789175660.357564:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789175660.357616:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789175660.357693:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789175660.357833:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789175660.357876:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789175660.357936:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789175660.357982:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789175660.358012:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789175660.358060:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789175660.358104:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789175660.358146:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789175660.358187:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789175660.358244:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789175660.358294:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789175660.358396:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789175660.358444:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789175660.358542:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789175660.358551:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789175660.358648:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789175660.358798:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175660.358855:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7265accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175660.359393:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274224896 00000100:00100000:1.0:1789175660.359402:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274224896 00000100:00100000:1.0:1789175660.359449:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789175660.359461:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274224896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175660.359723:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274224896:12345-0@lo:501:mount.lustre.0 Request processed in 265us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.359732:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789175660.360411:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274224896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789175660.360456:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789175660.360556:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.360590:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.360597:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225024 00000100:00100000:3.0:1789175660.360603:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225024 00000100:00100000:3.0:1789175660.360642:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789175660.360651:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789175660.360801:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225024:12345-0@lo:503:mount.lustre.0 Request processed in 152us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.360810:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789175660.360836:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789175660.362910:0:15771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789175660.362981:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.363037:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.363079:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175660.363099:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225152 00000100:00100000:1.0:1789175660.363104:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225152 00000100:00100000:1.0:1789175660.363135:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789175660.363143:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.363326:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225152:12345-0@lo:502:mount.lustre.0 Request processed in 184us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.363379:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789175660.363442:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175660.364221:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789175660.364281:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789175660.364318:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789175660.364475:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789175660.364585:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789175660.364648:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789175660.364696:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789175660.364731:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789175660.364859:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789175660.364897:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789175660.364934:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789175660.364979:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789175660.365014:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789175660.365049:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789175660.365091:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789175660.365124:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789175660.365154:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789175660.365195:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789175660.365225:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789175660.365253:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789175660.365297:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789175660.365326:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789175660.365403:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789175660.365460:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789175660.365499:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789175660.365646:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789175660.365732:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789175660.365838:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789175660.365871:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789175660.365913:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789175660.365943:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789175660.365979:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789175660.366009:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789175660.366057:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789175660.366099:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789175660.366148:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789175660.366190:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789175660.366246:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789175660.366330:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789175660.366476:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789175660.366586:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789175660.366667:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.367623:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175660.367709:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225280 00000100:00100000:3.0:1789175660.367720:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225280 00000100:00100000:3.0:1789175660.367819:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789175660.367827:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789175660.368035:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274225280:12345-0@lo:502:mount.lustre.0 Request processed in 209us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.368041:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789175660.368129:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274225280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789175660.368223:0:15771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789175660.368241:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789175660.370148:0:15781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789175660.370164:0:15781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97e73c4f8000) 00000020:00000080:2.0:1789175660.370181:0:15781:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789175660.370242:0:15781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97e7030e5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789175660.370244:0:15781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97e7030e5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789175660.370246:0:15781:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97e7030e5800 3 00010000:00080000:2.0:1789175660.370270:0:15781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97e6036d3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1789175660.372064:0:15781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789175660.372276:0:15781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789175660.372303:0:15781:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789175660.372314:0:15781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1112cdeac4c178e3 00000100:00080000:2.0:1789175660.372324:0:15781:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789175660.372330:0:15781:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97e6036d3000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175660.372420:0:15781:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60365ce00 x1876086274225408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789175660.372448:0:15781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789175660.372497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789175660.372502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789175660.372515:0:8:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789175660.372520:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1789175660.372531:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789175660.372536:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e737ce4000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1789175660.372549:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60365ed80 x1876086274225664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789175660.372602:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274225536:0@lo:400:kworker.0 00000100:00100000:2.0:1789175660.372668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.372705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175660.372710:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274225792:0@lo:400:kworker.0 00000100:00100000:2.0:1789175660.372730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175660.372768:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274225408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789175660.372768:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274225920:0@lo:400:kworker.0 00000100:00100000:2.0:1789175660.372794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175660.372804:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225536 00000100:00100000:3.0:1789175660.372811:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225536 00000100:00100000:2.0:1789175660.372830:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225792 00000100:00100000:2.0:1789175660.372833:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225792 00000100:00100000:2.0:1789175660.372858:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225920 00000100:00100000:3.0:1789175660.372860:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175660.372860:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225920 00000100:00100000:3.0:1789175660.372869:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274225536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175660.372894:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789175660.372901:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274225792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175660.372917:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274225536:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175660.372924:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789175660.372930:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876086274225792:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175660.372935:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175660.372944:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.372946:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225408 00000100:00100000:2.0:1789175660.372949:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225408 00000100:00100000:2.0:1789175660.372963:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789175660.372970:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274225664:0@lo:8:kworker.0 00000100:00100000:2.0:1789175660.372970:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274225920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175660.372994:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.373006:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876086274225920:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175660.373021:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789175660.373024:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175660.373029:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789175660.373031:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175660.373040:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1876086274225408:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789175660.373042:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274225664 00000100:00100000:3.0:1789175660.373047:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274225664 00010000:00080000:0.0:1789175660.373063:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000100:00100000:3.0:1789175660.373067:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789175660.373070:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e60365d180 x1876086274225920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175660.373073:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876086274225664:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789175660.373084:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1876086274225920:0@lo:400:kworker.0 00000020:00000080:0.0:1789175660.373119:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1112cdeac4c178ea 00000100:00100000:3.0:1789175660.373312:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1876086274225664:12345-0@lo:8:kworker.0 Request processed in 236us (315us total) trans 0 rc -11/-11 00000004:00100000:0.0:1789175660.373314:0:14368:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789175660.373323:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789175660.373375:0:14368:0:(import.c:65:import_set_state_nolock()) ffff97e73be0e000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789175660.373418:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e60365c700 x1876086274225792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175660.373423:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876086274225408:12345-0@lo:38:llog_process_th.0 Request processed in 382us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175660.373439:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876086274225792:0@lo:400:kworker.0 00000100:00100000:0.0:1789175660.373440:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175660.373456:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789175660.373483:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274225536:0@lo:400:kworker.0 00010000:00080000:3.0:1789175660.373828:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97e60365ce00 x1876086274225408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789175670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175660.373842:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789175660.373847:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789175660.373854:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789175660.373858:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789175660.373860:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e6036d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789175660.373865:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1876086274225408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789175660.373877:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789175660.373880:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789175660.373883:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789175660.373886:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274225664:0@lo:8:kworker.0 00000040:00080000:3.0:1789175660.374643:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789175660.374697:0:15771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789175660.374723:0:15771:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789175660.374736:0:15771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178d5 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.374755:0:15771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e705668000/0x1112cdeac4c178ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178d5 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789175660.374787:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789175660.374789:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789175660.374792:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175660.374793:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175660.374794:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175660.374794:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175660.374795:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175660.374796:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175660.374797:0:15771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789175660.374800:0:15771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789175660.374802:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789175660.374803:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789175660.374804:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789175660.374805:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789175660.374806:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789175660.374807:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789175660.374808:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789175660.374809:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789175660.374810:0:15771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789175660.374825:0:15771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789175660.374838:0:15771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274226048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789175660.374878:0:15771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.374903:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226048 00000100:00100000:1.0:1789175660.374906:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226048 00000100:00100000:1.0:1789175660.374936:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789175660.374942:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:15771:x1876086274226048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789175660.374969:0:14360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789175660.374982:0:14360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789175660.375239:0:15771:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc98840 going to sleep for 11 seconds 20000000:01000000:0.0:1789175660.389590:0:14360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789175660.389608:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789175660.389639:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789175660.389646:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789175660.389668:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.389689:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.389698:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.389737:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.389751:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 19 pid: 14361 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175660.389765:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274226176:0@lo:104: 00000100:00100000:2.0:1789175660.389844:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175660.389886:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226176 00000100:00100000:2.0:1789175660.389892:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926480 going to sleep for 11 seconds 00000100:00100000:0.0:1789175660.389896:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226176 00000100:00100000:2.0:1789175660.390037:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789175660.390049:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274226176:12345-0@lo:104: 00010000:00010000:2.0:1789175660.390064:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.390130:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175660.390138:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:14383:x1876086274226176:12345-0@lo:104: Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.390139:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1876086274226176:0@lo:104: 00000100:00100000:2.0:1789175660.390145:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789175660.390160:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390223:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175660.390231:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390240:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e7050f9a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175660.390244:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390252:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175660.390260:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175660.390267:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789175660.390308:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390315:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175660.390377:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390385:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e7050f9a00/0x1112cdeac4c177c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c177cb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175660.390398:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175660.390400:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175660.390402:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175660.390419:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274226304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789175660.390452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175660.390611:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226304 00000100:00100000:1.0:1789175660.390616:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226304 00010000:00010000:1.0:1789175660.390636:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 20 pid: 14361 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175660.390671:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789175660.390679:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71fe837c-1812-4075-866f-5d0b367ca590+20:3305:x1876086274226304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789175660.390689:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175660.390694:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 20 pid: 14361 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390704:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 20 pid: 14361 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390716:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e7050f8a00/0x1112cdeac4c177cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c177c4 expref: 20 pid: 14361 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390728:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390736:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789175660.390758:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002055732s 00010000:00010000:1.0:1789175660.390763:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390770:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390777:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390784:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390794:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175660.390799:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390807:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390820:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175660.390829:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175660.390831:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.390838:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175660.390844:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72e1b5a00/0x1112cdeac4c178f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175660.390862:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71fe837c-1812-4075-866f-5d0b367ca590+19:3305:x1876086274226304:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.390870:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175660.390897:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274226304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789175660.394303:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+18:15771:x1876086274226048:12345-0@lo:253:mount.lustre.0 Request processed in 19351us (19415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175660.394318:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789175660.394328:0:15771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:71fe837c-1812-4075-866f-5d0b367ca590:15771:1876086274226048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789175660.394511:0:15771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789175660.394515:0:15771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789175660.394516:0:15771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789175660.394518:0:15771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789175660.394519:0:15771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789175660.394520:0:15771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789175660.394534:0:15771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789175660.394536:0:15771:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789175660.394537:0:15771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789175660.394539:0:15771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789175660.394554:0:15771:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789175660.397006:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175660.397120:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175660.397221:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175660.397309:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789175660.397547:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789175660.397699:0:15771:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789175660.399983:0:15771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789175660.433822:0:15771:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789175660.433828:0:15771:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789175660.433855:0:15771:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789175660.433900:0:15771:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789175660.433911:0:15771:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789175660.433935:0:15771:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1789175660.961681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175660.961712:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274226432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175660.961807:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175660.961934:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226432 00000100:00100000:2.0:1789175660.961944:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226432 00000100:00100000:2.0:1789175660.962011:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175660.962024:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274226432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175660.962069:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175660.962139:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274226432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175660.962146:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789175660.962698:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274226432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789175661.090374:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789175661.988136:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789175661.988147:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97e73474e000 from 8 10000000:01000000:3.0:1789175661.988154:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789175661.988218:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175661.988234:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175661.988248:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175661.988284:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274226560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175661.988405:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175661.988585:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7219bd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789175661.988999:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226560 00000100:00100000:1.0:1789175661.989014:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226560 00000100:00100000:1.0:1789175661.989097:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789175661.989109:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274226560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175661.989125:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175661.989145:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b200/0x1112cdeac4c178ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c178f8 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175661.989178:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b200/0x1112cdeac4c178ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c178f8 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175661.989201:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b200/0x1112cdeac4c178ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c178f8 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175661.989214:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b200, rc 0) 00000100:00100000:1.0:1789175661.989277:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274226560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175661.989284:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789175661.989367:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274226560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175661.989387:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ff expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175661.989397:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c178ff expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175661.989475:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274226688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789175661.989514:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175661.989532:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7146d9240 going to sleep for 11 seconds 00000100:00100000:1.0:1789175661.989546:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226688 00000100:00100000:1.0:1789175661.989550:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226688 00000100:00100000:1.0:1789175661.989572:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789175661.989579:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274226688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789175661.989596:0:14360:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789175661.989620:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789175661.989624:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789175661.989721:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274226688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175661.990024:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789175661.990066:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274226688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789175661.990134:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789175661.990142:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ff expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175661.990152:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700030400/0x1112cdeac4c178f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c178ff expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175662.114276:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789175662.567713:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789175663.138957:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175664.174939:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175665.190371:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789175665.569734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789175665.569741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789175665.569745:0:8:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789175665.569758:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97e737ce4000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1789175665.569784:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97e60390b480 x1876086274227072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789175665.569904:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274226944:0@lo:400:kworker.0 00000100:00100000:3.0:1789175665.569984:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175665.570049:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175665.570056:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274227200:0@lo:400:kworker.0 00000100:00100000:3.0:1789175665.570083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175665.570126:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274227072:0@lo:8:kworker.0 00000100:00100000:3.0:1789175665.570150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175665.570180:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226944 00000100:00100000:3.0:1789175665.570188:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226944 00000100:00100000:3.0:1789175665.570238:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227072 00000100:00100000:3.0:1789175665.570241:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227072 00000100:00100000:3.0:1789175665.570267:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789175665.570277:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274226944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175665.570332:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274226944:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175665.570366:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789175665.570384:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175665.570388:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1876086274227072:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789175665.570414:0:15051:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1789175665.570454:0:15051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1112cdeac4c17906 00002000:00100000:3.0:1789175665.570471:0:15051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97e734454000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789175665.570475:0:15051:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789175665.570478:0:15051:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789175665.570911:0:15051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789175665.570934:0:15051:0:(import.c:65:import_set_state_nolock()) ffff97e734457800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789175665.570979:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876086274227072:12345-0@lo:8:kworker.0 Request processed in 589us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175665.570988:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175665.571014:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227200 00000100:00100000:3.0:1789175665.571019:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227200 00000100:00100000:3.0:1789175665.571051:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175665.571057:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274227200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175665.571087:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876086274227200:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175665.571094:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789175665.571114:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789175665.571152:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e60390b480 x1876086274227072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789175690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789175665.571171:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789175665.571178:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789175665.571183:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789175665.571186:0:3303:0:(import.c:65:import_set_state_nolock()) ffff97e737ce4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789175665.571208:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789175665.571214:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1876086274227072:0@lo:8:kworker.0 00010000:00080000:3.0:1789175665.571257:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e603908380 x1876086274227200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789175665.571275:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876086274227200:0@lo:400:kworker.0 00000100:00100000:3.0:1789175665.571292:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274226944:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.571749:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274226816:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.571794:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175665.571833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274227456:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.571861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175665.571885:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789175665.571891:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274227328:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.571914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789175665.571976:0:14392:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789175665.572006:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1876086274227712:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789175665.572033:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175665.572051:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e70545d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789175665.572067:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274226816 00000100:00100000:0.0:1789175665.572072:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274226816 00000100:00100000:0.0:1789175665.572109:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789175665.572116:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e734269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:3307:x1876086274226816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.572154:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e734269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:3307:x1876086274226816:12345-0@lo:400:kworker.0 Request processed in 39us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175665.572161:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789175665.572192:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227456 00000100:00100000:0.0:1789175665.572195:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227456 00000100:00100000:0.0:1789175665.572224:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227328 00000100:00100000:0.0:1789175665.572227:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227328 00000100:00100000:0.0:1789175665.572261:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175665.572268:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274227456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.572300:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274227456:12345-0@lo:400:kworker.0 Request processed in 33us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175665.572306:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175665.572317:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175665.572323:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274227328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.572370:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274227328:12345-0@lo:400:kworker.0 Request processed in 48us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175665.572377:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175665.572402:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175665.572410:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274227584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789175665.572436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175665.572478:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227584 00000100:00100000:0.0:1789175665.572482:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227584 00000100:00100000:0.0:1789175665.572511:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789175665.572518:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274227584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789175665.572546:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175665.572581:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876086274227584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175665.572587:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789175665.572604:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789175665.572608:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789175665.572628:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e72643d500 x1876086274227584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789175681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175665.572645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274227584:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789175665.572672:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e603909180 x1876086274227328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175665.572682:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e603909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274227328:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.572691:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274226816:0@lo:400:kworker.0 00010000:00080000:0.0:1789175665.572700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97e60390a680 x1876086274227456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789175681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789175665.572706:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60390a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274227456:0@lo:400:kworker.0 00000100:00100000:0.0:1789175665.572733:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227712 00000100:00100000:0.0:1789175665.572736:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227712 00000100:00100000:0.0:1789175665.572761:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789175665.572769:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1876086274227712:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789175665.575984:0:14391:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789175665.576430:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 450535087488ns, next at 0ns, rc = 0 00002000:00080000:0.0:1789175665.586800:0:15051:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789175665.586821:0:15051:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789175665.586827:0:15051:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1789175665.601706:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.601717:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601734:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.601739:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.601746:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601763:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601773:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601782:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601799:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.601809:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.601814:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601821:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.601826:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601843:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601859:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601867:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c990f6/0x1112cdeac4c1790d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.601884:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.601885:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.601887:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.602333:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.602358:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602368:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.602371:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.602375:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602385:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602393:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602406:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602421:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.602429:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.602434:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602440:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.602444:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602452:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602462:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602470:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de9e4db/0x1112cdeac4c17914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602482:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.602483:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.602485:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.602820:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.602831:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602840:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.602844:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.602848:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602858:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602865:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602873:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602886:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.602893:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.602896:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602903:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.602907:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602914:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602930:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602939:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002451e2c7/0x1112cdeac4c1791b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.602951:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.602952:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.602954:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.608747:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.608762:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.608780:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.608785:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.608793:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.608808:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.608819:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.608827:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.608878:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175665.610186:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.610206:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610223:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.610231:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610255:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610293:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610302:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9254a6/0x1112cdeac4c17922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610386:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.610389:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.610393:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.610486:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.610497:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.610513:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.610516:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.610522:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.610535:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.610546:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.610553:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.610584:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175665.610702:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.610711:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610742:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.610746:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610756:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610775:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610783:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000724224c4/0x1112cdeac4c17929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.610824:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.610827:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.610833:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.611121:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.611128:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.611138:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.611148:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.611153:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.611165:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.611176:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.611184:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.611207:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175665.611732:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.611740:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.611752:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.611755:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.611765:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.611793:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.611802:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12b2ace/0x1112cdeac4c17930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.611826:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.611828:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.611830:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.612708:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.612718:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.612734:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.612738:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.612744:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.612756:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.612765:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.612781:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.612804:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175665.612866:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.612878:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.612890:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.612895:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.612905:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.612923:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.612931:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060caa0db/0x1112cdeac4c17937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.612972:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.612976:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.612979:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.613684:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.613693:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613705:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.613709:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.613715:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613728:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613737:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613744:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613766:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.613782:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.613789:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613806:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705668e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.613812:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613823:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613844:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613852:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2e9c6be/0x1112cdeac4c1793e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.613882:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.613885:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.613891:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.615141:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.615150:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.615164:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.615168:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.615174:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.615187:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.615203:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.615211:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.615233:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789175665.615987:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.615994:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616005:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.616009:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.616014:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616023:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616032:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616039:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616070:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175665.616088:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175665.616093:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616108:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.616113:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616123:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616139:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616146:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d2ea392/0x1112cdeac4c17945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616169:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.616173:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616179:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.616182:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616202:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616213:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616221:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9eaf7ba/0x1112cdeac4c1794c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.616235:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.616236:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.616238:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.616511:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.617027:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.617036:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.617049:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.617052:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.617058:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.617068:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.617082:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.617097:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.617127:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789175665.617841:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.617848:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618022:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.618026:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.618032:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618044:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618054:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618061:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618078:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789175665.618543:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789175665.618561:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618578:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.618585:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618598:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618628:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618636:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4d0c49a/0x1112cdeac4c17953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618680:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.618685:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618693:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.618713:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618722:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618738:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618745:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001068bd0e/0x1112cdeac4c1795a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.618779:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.618783:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.618789:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.618828:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.618928:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.618937:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618955:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.618959:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.618964:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618975:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618984:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.618992:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.619015:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789175665.619954:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.619962:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.619975:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.619979:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.619986:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.619999:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620021:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620029:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620050:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175665.620064:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175665.620071:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620079:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.620084:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620095:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620114:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620122:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa1fd6e/0x1112cdeac4c17961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620143:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.620152:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620159:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.620163:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620171:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620182:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620189:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000117025fa/0x1112cdeac4c17968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.620201:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.620203:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.620206:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.620552:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.621064:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.621076:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621089:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.621093:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.621098:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621123:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621133:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621141:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621161:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.621173:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.621178:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621186:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6c00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.621190:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621199:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621213:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621221:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c7011a7/0x1112cdeac4c1796f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.621258:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.621260:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.621333:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.621990:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.621998:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.622008:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.622011:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.622017:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.622028:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.622037:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.622044:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.622059:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789175665.623001:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.623009:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623034:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.623038:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.623043:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623054:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623064:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623072:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623090:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175665.623102:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175665.623108:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623115:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.623120:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623128:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623544:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623555:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c17976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623576:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.623580:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623587:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.623591:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623598:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623607:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623615:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c1797d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.623632:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.623634:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.623643:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.624163:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.624171:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624181:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.624185:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.624190:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624202:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624211:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624219:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624235:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.624258:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.624263:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624270:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.624494:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624516:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624528:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624534:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.624548:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.624550:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.624551:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.628601:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789175665.631913:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.631929:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.631948:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.631953:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.631960:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.631977:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.631990:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.632012:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.632044:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.632053:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.632064:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.632076:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.632082:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.632094:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.632116:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.632137:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c1798b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.632168:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.632173:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.632175:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789175665.643324:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.643360:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.643391:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.643396:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.643402:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.643418:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.643428:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.643436:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.643452:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789175665.644014:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.644022:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.644040:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.644044:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.644049:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.644060:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.644069:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.644077:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.644105:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789175665.644125:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789175665.644132:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644139:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.644143:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644150:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644164:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644170:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e881493e/0x1112cdeac4c17992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644185:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.644188:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644197:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.644200:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644205:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644215:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644222:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbaff074/0x1112cdeac4c17999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.644237:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.644240:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.644252:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.645571:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789175665.647100:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.647110:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647139:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.647145:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.647151:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647165:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647188:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647195:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647224:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789175665.647237:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789175665.647259:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.647334:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175665.647338:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.647367:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.647388:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.647393:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1c5886c/0x1112cdeac4c179a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.647480:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.647483:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.647486:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789175665.647730:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.647737:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647746:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.647750:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.647754:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647765:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647773:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647781:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.647806:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789175665.648235:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.648258:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.648268:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.648271:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.648276:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.648285:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.648294:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.648301:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.648327:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789175665.648907:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789175665.648916:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648926:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654ba00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.648931:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648941:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648966:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648971:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1e196c7/0x1112cdeac4c179a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648986:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175665.648989:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.648992:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.648995:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.649000:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.649005:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.649009:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000caddcd7/0x1112cdeac4c179ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.649017:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.649018:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.649023:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175665.650735:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789175665.656298:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789175665.656310:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.656327:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=450s v=(0 0) 00010000:00010000:1.0:1789175665.656374:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175665.656382:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.656399:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.656410:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.656418:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659886:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175665.659899:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789175665.659902:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659920:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175665.659926:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659939:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659960:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659966:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c179b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175665.659996:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.659999:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175665.660002:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789175665.665815:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.665830:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.665848:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.665852:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.665858:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.665872:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.665883:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.665891:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.665930:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789175665.666275:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789175665.666283:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.666291:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175665.666295:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.666304:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.666320:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.666360:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c179bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.668708:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175665.668715:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175665.668718:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789175665.672924:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:0.0:1789175665.675719:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789175665.676009:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.676020:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.676038:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.676043:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.676049:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.676064:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.676075:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.676083:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.676313:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789175665.677001:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789175665.677009:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.677020:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789175665.677031:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175665.677037:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.677050:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.677060:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.677067:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175665.677082:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789175665.677212:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789175665.677219:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677249:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175665.677255:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677264:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677283:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677290:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001366e169/0x1112cdeac4c179c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677310:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789175665.677314:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677321:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6000 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175665.677324:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677330:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677354:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175665.677360:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175665.677441:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063b3b603/0x1112cdeac4c179ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175665.677456:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175665.677457:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175665.677459:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789175665.677696:0:15051:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1789175665.677806:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14392:x1876086274227712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 105035us (105768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175665.677817:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789175665.678275:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1876086274227712:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789175665.678291:0:14392:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1789175665.678358:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1876086274227840:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789175665.678405:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175665.678455:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73448bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175665.678464:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227840 00000100:00100000:2.0:1789175665.678471:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227840 00000100:00100000:2.0:1789175665.678510:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789175665.678519:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14392:x1876086274227840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789175665.678557:0:15050:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789175665.691323:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14392:x1876086274227840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12795us (12909us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789175665.691338:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789175665.691452:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1876086274227840:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789175665.691472:0:14392:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789175666.081813:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274227968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175666.081895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175666.081980:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274227968 00000100:00100000:0.0:1789175666.081988:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274227968 00000100:00100000:0.0:1789175666.082034:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175666.082043:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274227968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175666.082080:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175666.082123:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274227968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175666.082141:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789175666.082190:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274227968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789175666.210195:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789175666.985926:0:16128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789175667.248290:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175668.264123:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789175669.281472:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175669.454395:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175669.454881:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251166976 00000100:00100000:3.0:1789175669.454893:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251166976 00000100:00100000:3.0:1789175669.454943:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:3.0:1789175669.454953:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73426a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1876086251166976:12345-192.168.201.18@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789175669.454982:0:14361:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8a85c3d9-8b76-4448-9474-6fdc286de2f5@192.168.201.18@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:3.0:1789175669.455013:0:14361:0:(genops.c:1385:class_connect()) connect: client 8a85c3d9-8b76-4448-9474-6fdc286de2f5, cookie 0x1112cdeac4c179d1 00000100:00080000:3.0:1789175669.455190:0:14361:0:(import.c:65:import_set_state_nolock()) ffff97e7030e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789175669.455269:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73426a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+5:2352:x1876086251166976:12345-192.168.201.18@tcp:250:mount.lustre.0 Request processed in 315us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175669.455276:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:3.0:1789175669.458944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.459051:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167104 00000100:00100000:0.0:1789175669.459061:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167104 00000100:00100000:0.0:1789175669.459128:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1789175669.459139:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+5:13762:x1876086251167104:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789175669.459154:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175669.459183:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e6025a7200/0x1112cdeac4c179d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f50 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.459214:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e6025a7200/0x1112cdeac4c179d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f50 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.459227:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e6025a7200/0x1112cdeac4c179d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f50 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.459236:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7200, rc 0) 00000100:00100000:0.0:1789175669.459313:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+6:13762:x1876086251167104:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 176us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.459328:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:2.0:1789175669.462415:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.463517:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167232 00000100:00100000:0.0:1789175669.463530:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167232 00000100:00100000:0.0:1789175669.463600:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1789175669.463611:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+6:13762:x1876086251167232:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789175669.463976:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+6:13762:x1876086251167232:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 358us (1572us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789175669.463995:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:1.0:1789175669.483952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175669.484138:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167360 00000100:00100000:3.0:1789175669.484153:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167360 00000100:00100000:3.0:1789175669.484253:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:3.0:1789175669.484266:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+6:13762:x1876086251167360:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789175669.484561:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175669.484591:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e700031e00/0x1112cdeac4c179df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f57 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175669.484632:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e700031e00/0x1112cdeac4c179df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f57 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175669.484647:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e700031e00/0x1112cdeac4c179df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f57 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175669.484658:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031e00, rc 0) 00000100:00100000:3.0:1789175669.484751:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+7:13762:x1876086251167360:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 486us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175669.484760:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1789175669.494392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.494602:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167488 00000100:00100000:1.0:1789175669.494615:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167488 00000100:00100000:1.0:1789175669.494675:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:1.0:1789175669.494687:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+7:13762:x1876086251167488:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789175669.495109:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13762:x1876086251167488:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 423us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.495120:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1789175669.503016:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.507476:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167616 00000100:00100000:0.0:1789175669.507499:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167616 00000100:00100000:1.0:1789175669.511607:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:1.0:1789175669.511629:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13762:x1876086251167616:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789175669.512067:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13762:x1876086251167616:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 441us (9065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.512077:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:1.0:1789175669.528717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.528821:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167744 00000100:00100000:0.0:1789175669.528836:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167744 00000100:00100000:0.0:1789175669.528918:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:0.0:1789175669.528932:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13781:x1876086251167744:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789175669.529800:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13781:x1876086251167744:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 863us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.529813:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:2.0:1789175669.560223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.560389:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251167872 00000100:00100000:1.0:1789175669.560402:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251167872 00000100:00100000:1.0:1789175669.560472:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:1.0:1789175669.560484:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13781:x1876086251167872:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175669.560998:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13781:x1876086251167872:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 514us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.561007:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1789175669.569123:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.575666:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168000 00000100:00100000:0.0:1789175669.575693:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168000 00000100:00100000:0.0:1789175669.575792:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1789175669.575806:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+8:13762:x1876086251168000:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789175669.575828:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175669.575852:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e6025a7000/0x1112cdeac4c179e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f81 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.575890:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e6025a7000/0x1112cdeac4c179e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f81 expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.575903:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e6025a7000/0x1112cdeac4c179e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f81 expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175669.575914:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7000, rc 0) 00000100:00100000:0.0:1789175669.576101:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+9:13762:x1876086251168000:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 297us (6995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.576136:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:3.0:1789175669.584314:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.584561:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168128 00000100:00100000:1.0:1789175669.584574:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168128 00000100:00100000:1.0:1789175669.584830:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1789175669.584843:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+9:13762:x1876086251168128:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789175669.584880:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789175669.584913:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789175669.584917:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789175669.584920:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789175669.584923:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789175669.589073:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+9:13762:x1876086251168128:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 4202us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.589095:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:2.0:1789175669.592210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.592453:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168256 00000100:00100000:1.0:1789175669.592466:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168256 00000100:00100000:1.0:1789175669.592538:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:1.0:1789175669.592550:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+9:13762:x1876086251168256:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789175669.592570:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175669.592594:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2f88 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175669.592642:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175669.592803:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175669.592816:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175669.592897:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13762:x1876086251168256:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 348us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.592905:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:3.0:1789175669.599854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.600397:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168384 00000100:00100000:1.0:1789175669.600412:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168384 00000100:00100000:1.0:1789175669.600493:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1789175669.600505:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13762:x1876086251168384:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789175669.601185:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13762:x1876086251168384:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 666us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175669.601209:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:2.0:1789175669.604946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.605061:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168512 00000100:00100000:0.0:1789175669.605076:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168512 00000100:00100000:0.0:1789175669.605164:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1789175669.605186:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13762:x1876086251168512:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789175669.605725:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13762:x1876086251168512:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 548us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.605734:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1789175669.610327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.610892:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168640 00000100:00100000:0.0:1789175669.610907:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168640 00000100:00100000:0.0:1789175669.610989:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1789175669.611002:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13785:x1876086251168640:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789175669.611677:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13785:x1876086251168640:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 674us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.611687:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:3.0:1789175669.619860:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175669.620127:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168768 00000100:00100000:2.0:1789175669.620141:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168768 00000100:00100000:2.0:1789175669.620240:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:2.0:1789175669.620252:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13785:x1876086251168768:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175669.620633:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13785:x1876086251168768:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 382us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175669.620642:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:2.0:1789175669.630224:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.631730:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251168896 00000100:00100000:0.0:1789175669.631752:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251168896 00000100:00100000:0.0:1789175669.631842:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1789175669.631854:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1876086251168896:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789175669.631897:0:14399:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b7bd2b70-0ce4-4e4a-920a-a90831c72597@192.168.201.18@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1789175669.631968:0:14399:0:(genops.c:1385:class_connect()) connect: client b7bd2b70-0ce4-4e4a-920a-a90831c72597, cookie 0x1112cdeac4c179f4 00000004:00100000:0.0:1789175669.632011:0:14399:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789175669.632020:0:14399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1789175669.709259:0:14399:0:(import.c:65:import_set_state_nolock()) ffff97e73be0a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175669.709598:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2352:x1876086251168896:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 77741us (79387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.709612:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1789175669.712270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175669.712324:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175669.712529:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169152 00000100:00100000:3.0:1789175669.712540:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169152 00000100:00100000:3.0:1789175669.712647:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169024 00000100:00100000:3.0:1789175669.712650:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169024 00000100:00100000:3.0:1789175669.712675:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1789175669.712686:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:13762:x1876086251169152:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789175669.712744:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789175669.712872:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:13762:x1876086251169152:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 187us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175669.712880:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1789175669.712900:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175669.712907:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:0:x1876086251169024:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789175669.712919:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789175669.712940:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:0:x1876086251169024:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175669.712947:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00080000:1.0:1789175669.713991:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175669.719449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175669.719701:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169280 00000100:00100000:3.0:1789175669.719715:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169280 00000100:00100000:3.0:1789175669.719791:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175669.719805:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:13762:x1876086251169280:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789175669.719922:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:13762:x1876086251169280:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 121us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175669.719931:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175669.723635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175669.723751:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169408 00000100:00100000:0.0:1789175669.723764:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169408 00000100:00100000:0.0:1789175669.723826:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1789175669.723836:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251169408:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789175669.723881:0:15051:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b7bd2b70-0ce4-4e4a-920a-a90831c72597@192.168.201.18@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1789175669.723933:0:15051:0:(genops.c:1385:class_connect()) connect: client b7bd2b70-0ce4-4e4a-920a-a90831c72597, cookie 0x1112cdeac4c179fb 00002000:00100000:0.0:1789175669.723951:0:15051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b7bd2b70-0ce4-4e4a-920a-a90831c72597/ffff97e73be0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175669.723988:0:15051:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175669.724482:0:15051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789175669.724528:0:15051:0:(import.c:65:import_set_state_nolock()) ffff97e7201da000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175669.724625:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2352:x1876086251169408:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 788us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.724635:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1789175669.725124:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175669.725265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175669.725393:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169664 00000100:00100000:1.0:1789175669.725401:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169664 00000100:00100000:1.0:1789175669.725444:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1789175669.725453:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:13762:x1876086251169664:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789175669.726144:0:14369:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 611us 00000100:00100000:0.0:1789175669.728282:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169536 00000100:00100000:0.0:1789175669.728301:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169536 00000100:00100000:0.0:1789175669.728386:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175669.728397:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876086251169536:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789175669.728441:0:15050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b7bd2b70-0ce4-4e4a-920a-a90831c72597@192.168.201.18@tcp t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1789175669.728482:0:15050:0:(genops.c:1385:class_connect()) connect: client b7bd2b70-0ce4-4e4a-920a-a90831c72597, cookie 0x1112cdeac4c17a02 00002000:00100000:0.0:1789175669.728499:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b7bd2b70-0ce4-4e4a-920a-a90831c72597/ffff97e7201df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175669.728531:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175669.728770:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789175669.728816:0:15050:0:(import.c:65:import_set_state_nolock()) ffff97e7201d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175669.728913:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2352:x1876086251169536:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 516us (3789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175669.728922:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000004:00200000:2.0:1789175669.772855:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789175669.773072:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:13762:x1876086251169664:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 47611us (47797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175669.773090:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1789175669.998163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175669.998316:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169792 00000100:00100000:2.0:1789175669.998331:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169792 00000100:00100000:2.0:1789175669.998440:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1789175669.998456:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:13805:x1876086251169792:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:2.0:1789175669.998486:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175669.998698:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c17a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2fb2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.998798:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.998816:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.998836:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175669.998898:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175669.998902:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175669.998944:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.998973:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5400/0x1112cdeac4c17a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fb2 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.998996:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fb2 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175669.999018:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175669.999022:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175669.999026:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4c00, rc 0) 00000100:00100000:2.0:1789175669.999113:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:13805:x1876086251169792:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 660us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175669.999121:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:1.0:1789175670.306569:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175670.689620:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274228096:0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.689695:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274228352:0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.689789:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175670.689995:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274228224:0@lo:400:kworker.0 00000100:00100000:1.0:1789175670.690223:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228352 00000100:00100000:1.0:1789175670.690236:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228352 00000100:00100000:1.0:1789175670.690313:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789175670.690327:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274228352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175670.693408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175670.693538:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274228480:0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.693627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175670.693708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274228736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175670.693734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175670.693792:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228480 00000100:00100000:2.0:1789175670.693801:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228480 00000100:00100000:2.0:1789175670.694240:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175670.694262:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274228480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.694320:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274228480:12345-0@lo:400:kworker.0 Request processed in 59us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175670.694327:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175670.694408:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274228480:0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.694451:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228736 00000100:00100000:2.0:1789175670.694455:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228736 00000100:00100000:0.0:1789175670.696353:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274228608:0@lo:400:kworker.0 00000100:00100000:0.0:1789175670.696464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175670.696542:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228608 00000100:00100000:0.0:1789175670.696551:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228608 00000100:00100000:0.0:1789175670.696623:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175670.696633:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274228608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175670.696705:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274228608:12345-0@lo:400:kworker.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175670.696713:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789175670.696768:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274228608:0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.697288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175670.697382:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274228864:0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.697446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175670.697515:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228864 00000100:00100000:3.0:1789175670.697523:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228864 00000100:00100000:3.0:1789175670.697598:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175670.697607:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274228864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.697860:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274228864:12345-0@lo:400:kworker.0 Request processed in 249us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175670.697868:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175670.697932:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274228864:0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.698288:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789175670.698300:0:15050:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789175670.698465:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228096 00000100:00100000:3.0:1789175670.698472:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228096 00000100:00100000:3.0:1789175670.698510:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789175670.698521:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:3306:x1876086274228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.698727:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:3306:x1876086274228096:12345-0@lo:400:kworker.0 Request processed in 206us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175670.698737:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789175670.698791:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274228096:0@lo:400:kworker.0 00000100:00100000:3.0:1789175670.698837:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228224 00000100:00100000:3.0:1789175670.698843:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228224 00000100:00100000:3.0:1789175670.698877:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789175670.698890:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175670.698899:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274228224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789175670.699046:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789175670.699056:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789175670.699060:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789175670.699124:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274228224:12345-0@lo:400:kworker.0 Request processed in 225us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175670.699262:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789175670.699301:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274228224:0@lo:400:kworker.0 00000100:00100000:2.0:1789175670.700011:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175670.700021:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876086274228736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175670.700040:0:15053:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175670.700104:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876086274228736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (6367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175670.700111:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175670.700172:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274228736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175670.704123:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274228352:12345-0@lo:400:kworker.0 Request processed in 13784us (14321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175670.704142:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789175670.706114:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274228352:0@lo:400:kworker.0 00000001:00100000:0.0:1789175670.807884:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b7bd2b70-0ce4-4e4a-920a-a90831c72597 00000001:00080000:0.0:1789175670.808009:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1789175671.205557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274228992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175671.205628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175671.205713:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274228992 00000100:00100000:2.0:1789175671.205722:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274228992 00000100:00100000:2.0:1789175671.205762:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175671.205771:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274228992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175671.205802:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175671.205846:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274228992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175671.205853:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175671.206607:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274228992:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789175671.272458:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b7bd2b70-0ce4-4e4a-920a-a90831c72597 00010000:00010000:2.0:1789175671.333738:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175672.012765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175672.012875:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251169920 00000100:00100000:0.0:1789175672.012886:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251169920 00000100:00100000:0.0:1789175672.012966:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175672.012977:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:13859:x1876086251169920:12345-192.168.201.18@tcp:41:lfs.0 00000004:00000024:0.0:1789175672.013020:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789175672.013112:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:13859:x1876086251169920:12345-192.168.201.18@tcp:41:lfs.0 Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175672.013129:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:1.0:1789175672.013700:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175672.021979:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.022089:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170048 00000100:00100000:2.0:1789175672.022101:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170048 00000100:00100000:2.0:1789175672.022204:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1789175672.022216:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:13859:x1876086251170048:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:2.0:1789175672.022244:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175672.022377:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:13859:x1876086251170048:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 162us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.022385:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00080000:1.0:1789175672.022882:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789175672.026373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.030680:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170176 00000100:00100000:3.0:1789175672.030696:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170176 00000100:00100000:3.0:1789175672.030798:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175672.030810:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:13859:x1876086251170176:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:3.0:1789175672.030853:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175672.030958:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:13859:x1876086251170176:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 151us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.030966:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:1.0:1789175672.031484:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789175672.240921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.241048:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170304 00000100:00100000:1.0:1789175672.241063:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170304 00000100:00100000:1.0:1789175672.241142:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:1.0:1789175672.241175:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+10:13891:x1876086251170304:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789175672.241197:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175672.241233:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a600/0x1112cdeac4c17a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2fb9 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.241282:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a600/0x1112cdeac4c17a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fb9 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.241297:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a600/0x1112cdeac4c17a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fb9 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.241309:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a600, rc 0) 00000100:00100000:1.0:1789175672.241450:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170304:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 278us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.241459:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:0.0:1789175672.253101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.253205:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170432 00000100:00100000:3.0:1789175672.253229:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170432 00000100:00100000:3.0:1789175672.253316:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:3.0:1789175672.253329:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170432:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789175672.253809:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170432:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 480us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.253818:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1789175672.260118:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.260390:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170560 00000100:00100000:3.0:1789175672.260406:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170560 00000100:00100000:3.0:1789175672.260484:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1789175672.260498:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170560:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789175672.261006:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170560:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 509us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.261029:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:0.0:1789175672.266466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.266601:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170688 00000100:00100000:1.0:1789175672.266616:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170688 00000100:00100000:1.0:1789175672.266694:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:1.0:1789175672.266708:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13898:x1876086251170688:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175672.267552:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13898:x1876086251170688:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 840us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.267565:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:0.0:1789175672.283247:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.283504:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170816 00000100:00100000:3.0:1789175672.283519:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170816 00000100:00100000:2.0:1789175672.283874:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:2.0:1789175672.283888:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73401ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13898:x1876086251170816:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175672.284432:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73401ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13898:x1876086251170816:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 543us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.284442:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:0.0:1789175672.290634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.290688:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251170944 00000100:00100000:1.0:1789175672.290704:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251170944 00000100:00100000:1.0:1789175672.290775:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:1.0:1789175672.290788:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13891:x1876086251170944:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789175672.290829:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175672.290849:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a200/0x1112cdeac4c17a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2fe3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.290880:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a200/0x1112cdeac4c17a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fe3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.290891:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a200/0x1112cdeac4c17a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fe3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.290899:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a200, rc 0) 00000100:00100000:1.0:1789175672.290965:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13891:x1876086251170944:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 180us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.290972:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:0.0:1789175672.293532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.293654:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171072 00000100:00100000:2.0:1789175672.293666:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171072 00000100:00100000:2.0:1789175672.293721:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:2.0:1789175672.293730:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13891:x1876086251171072:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789175672.293757:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789175672.293785:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789175672.293789:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789175672.293791:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789175672.293794:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789175672.295504:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13891:x1876086251171072:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 1761us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.295521:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:0.0:1789175672.302646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.302784:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171200 00000100:00100000:1.0:1789175672.302799:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171200 00000100:00100000:1.0:1789175672.302917:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:1.0:1789175672.302931:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13891:x1876086251171200:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789175672.302954:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175672.302975:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c2fea expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.303007:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.303017:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175672.303063:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b600, rc 0) 00000100:00100000:1.0:1789175672.303158:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13891:x1876086251171200:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 229us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.303166:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:0.0:1789175672.305109:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.305211:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171328 00000100:00100000:2.0:1789175672.305223:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171328 00000100:00100000:2.0:1789175672.305321:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:2.0:1789175672.305333:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13891:x1876086251171328:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789175672.305703:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13891:x1876086251171328:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 372us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.305710:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1789175672.306909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.306973:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171456 00000100:00100000:1.0:1789175672.306980:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171456 00000100:00100000:1.0:1789175672.307020:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:1.0:1789175672.307030:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e70856e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13891:x1876086251171456:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789175672.307476:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e70856e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13891:x1876086251171456:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 444us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.307485:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:0.0:1789175672.309613:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.309819:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171584 00000100:00100000:2.0:1789175672.309828:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171584 00000100:00100000:2.0:1789175672.309878:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:2.0:1789175672.309889:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13901:x1876086251171584:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789175672.310292:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13901:x1876086251171584:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 404us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.310305:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:0.0:1789175672.311752:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.311844:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171712 00000100:00100000:1.0:1789175672.311854:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171712 00000100:00100000:1.0:1789175672.311908:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:1.0:1789175672.311918:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13901:x1876086251171712:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789175672.312188:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13901:x1876086251171712:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 271us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175672.312196:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:0.0:1789175672.316169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.318908:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171840 00000100:00100000:3.0:1789175672.318931:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171840 00000100:00100000:3.0:1789175672.319086:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1789175672.319099:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1876086251171840:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789175672.319149:0:14366:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2aabdb8c-432a-4341-b40b-231e660be0f4@192.168.201.18@tcp t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:3.0:1789175672.319205:0:14366:0:(genops.c:1385:class_connect()) connect: client 2aabdb8c-432a-4341-b40b-231e660be0f4, cookie 0x1112cdeac4c17a2c 00000004:00100000:3.0:1789175672.319260:0:14366:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789175672.319495:0:14366:0:(import.c:65:import_set_state_nolock()) ffff97e7208e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789175672.319597:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2352:x1876086251171840:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 499us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.319606:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1789175672.331540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175672.331597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.331882:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172096 00000100:00100000:3.0:1789175672.331897:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172096 00000100:00100000:2.0:1789175672.334510:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251171968 00000100:00100000:2.0:1789175672.334530:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251171968 00000100:00100000:2.0:1789175672.334742:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1789175672.334756:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+7:0:x1876086251171968:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789175672.334821:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789175672.334929:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+7:0:x1876086251171968:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 175us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.334937:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175672.339375:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1789175672.339401:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172096:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789175672.339443:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789175672.339552:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172096:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 161us (8028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175672.339560:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00080000:1.0:1789175672.340557:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789175672.346770:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175672.346981:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172224 00000100:00100000:3.0:1789175672.346992:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172224 00000100:00100000:3.0:1789175672.347069:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1789175672.347081:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172224:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789175672.347223:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172224:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 143us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.347232:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175672.350487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.350520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175672.350543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.350612:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172352 00000100:00100000:2.0:1789175672.350625:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172352 00000100:00100000:0.0:1789175672.350639:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172480 00000100:00100000:0.0:1789175672.350644:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172480 00000100:00100000:2.0:1789175672.350687:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175672.350697:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876086251172352:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789175672.350739:0:15050:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2aabdb8c-432a-4341-b40b-231e660be0f4@192.168.201.18@tcp t0 exp 0000000000000000 cur 457 last 0 00000100:00100000:3.0:1789175672.350745:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172608 00000100:00100000:3.0:1789175672.350750:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172608 00000020:00000080:2.0:1789175672.350777:0:15050:0:(genops.c:1385:class_connect()) connect: client 2aabdb8c-432a-4341-b40b-231e660be0f4, cookie 0x1112cdeac4c17a33 00000100:00100000:3.0:1789175672.350789:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00100000:2.0:1789175672.350793:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2aabdb8c-432a-4341-b40b-231e660be0f4/ffff97e6036d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789175672.350803:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172608:12345-192.168.201.18@tcp:33:mount.lustre.0 00002000:00100000:2.0:1789175672.350807:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1789175672.350897:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789175672.350990:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13891:x1876086251172608:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 188us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175672.350998:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1789175672.351482:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175672.351499:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876086251172480:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789175672.351520:0:15051:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2aabdb8c-432a-4341-b40b-231e660be0f4@192.168.201.18@tcp t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1789175672.351544:0:15051:0:(genops.c:1385:class_connect()) connect: client 2aabdb8c-432a-4341-b40b-231e660be0f4, cookie 0x1112cdeac4c17a3a 00002000:00100000:0.0:1789175672.351551:0:15051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2aabdb8c-432a-4341-b40b-231e660be0f4/ffff97e712026000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789175672.351559:0:15051:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789175672.351758:0:15051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789175672.351799:0:15051:0:(import.c:65:import_set_state_nolock()) ffff97e712020800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789175672.351847:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2352:x1876086251172480:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 347us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175672.351854:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:1.0:1789175672.353877:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789175672.355990:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789175672.356067:0:15050:0:(import.c:65:import_set_state_nolock()) ffff97e6036d7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789175672.356210:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2352:x1876086251172352:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 5507us (5680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.356223:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1789175672.504492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175672.504648:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172736 00000100:00100000:2.0:1789175672.504662:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172736 00000100:00100000:2.0:1789175672.504794:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1789175672.504808:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+6:13922:x1876086251172736:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:2.0:1789175672.504838:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175672.504867:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.504974:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.504993:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.505027:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175672.505091:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175672.505096:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175672.505133:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.505167:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.505190:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175672.505200:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175672.505203:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175672.505207:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4a00, rc 0) 00000100:00100000:2.0:1789175672.505288:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+7:13922:x1876086251172736:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 483us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175672.505296:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000040:00080000:2.0:1789175672.802214:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789175673.377720:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789175674.403111:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789175674.842665:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b7bd2b70-0ce4-4e4a-920a-a90831c72597 00000001:00100000:0.0:1789175674.842687:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2aabdb8c-432a-4341-b40b-231e660be0f4 00000001:02000400:0.0:1789175675.244146:0:16332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789175675.426640:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175675.809936:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274229248:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.810045:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274229120:0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.810047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175675.810098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175675.810160:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274229632:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.810202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175675.810245:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274229376:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.810300:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274229504:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.810324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175675.810434:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229120 00000100:00100000:1.0:1789175675.810443:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229120 00000100:00100000:1.0:1789175675.810499:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789175675.810510:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:3306:x1876086274229120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.811225:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274229760:0@lo:400:kworker.0 00000100:00100000:1.0:1789175675.811330:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:3306:x1876086274229120:12345-0@lo:400:kworker.0 Request processed in 821us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175675.811362:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789175675.813972:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229632 00000100:00100000:2.0:1789175675.813991:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789175675.813992:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229632 00000100:00100000:2.0:1789175675.814009:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175675.814078:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229504 00000100:00100000:3.0:1789175675.814082:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229504 00000100:00100000:2.0:1789175675.814090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175675.814111:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175675.814120:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.814131:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175675.814187:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876086274229632:12345-0@lo:400:kworker.0 Request processed in 68us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814196:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789175675.814216:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175675.814223:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274229504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.814254:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274229504:12345-0@lo:400:kworker.0 Request processed in 32us (3929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814260:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789175675.814284:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229888 00000100:00100000:3.0:1789175675.814288:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229888 00000100:00100000:3.0:1789175675.814320:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175675.814327:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274229888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789175675.814398:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175675.814435:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274229888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814440:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789175675.814462:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229248 00000100:00100000:3.0:1789175675.814466:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229248 00000100:00100000:3.0:1789175675.814492:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229376 00000100:00100000:3.0:1789175675.814494:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229376 00000100:00100000:3.0:1789175675.814507:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175675.814665:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274229248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.814700:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876086274229248:12345-0@lo:400:kworker.0 Request processed in 187us (4653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814706:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175675.814717:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175675.814722:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274229376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.814748:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274229376:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814754:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175675.814782:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175675.814820:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1876086274229248:0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.814847:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274229760 00000100:00100000:3.0:1789175675.814850:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274229760 00000100:00100000:3.0:1789175675.814869:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175675.814874:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274229760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789175675.814902:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274229760:12345-0@lo:400:kworker.0 Request processed in 28us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175675.814917:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789175675.814940:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274229760:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.816411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274229120:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.816458:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1876086274229632:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.816518:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789175675.816532:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274229376:0@lo:400:kworker.0 00000100:00100000:2.0:1789175675.816573:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175675.816587:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274229504:0@lo:400:kworker.0 00000100:00080000:2.0:1789175675.816670:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789175675.816676:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789175675.816681:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789175675.919940:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2aabdb8c-432a-4341-b40b-231e660be0f4 00000100:00100000:2.0:1789175676.322179:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274230016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789175676.322285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175676.322519:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230016 00000100:00100000:0.0:1789175676.322531:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230016 00000100:00100000:0.0:1789175676.322599:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789175676.322614:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274230016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789175676.322666:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789175676.322724:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274230016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175676.322732:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789175676.323250:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274230016:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789175676.405878:0:6713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2aabdb8c-432a-4341-b40b-231e660be0f4 00010000:00010000:2.0:1789175676.450974:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175677.477332:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789175677.573687:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573777:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573809:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573832:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573867:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175677.573924:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173248 00000100:00100000:1.0:1789175677.573946:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173248 00000100:00100000:2.0:1789175677.574054:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172992 00000100:00100000:2.0:1789175677.574059:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172992 00000100:00100000:2.0:1789175677.574126:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173376 00000100:00100000:2.0:1789175677.574129:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173376 00000100:00100000:2.0:1789175677.574155:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175677.574179:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2355:x1876086251172992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175677.574304:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2355:x1876086251172992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 127us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175677.574312:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175677.574332:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175677.574338:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2356:x1876086251173376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175677.574385:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2356:x1876086251173376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 47us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175677.574391:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1789175677.574411:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173504 00000100:00100000:2.0:1789175677.574414:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173504 00000100:00100000:2.0:1789175677.574436:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173120 00000100:00100000:2.0:1789175677.574438:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173120 00000100:00100000:2.0:1789175677.574450:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173632 00000100:00100000:2.0:1789175677.574452:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173632 00000100:00100000:1.0:1789175677.574521:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1789175677.574529:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2355:x1876086251173504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175677.574557:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2355:x1876086251173504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175677.574564:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1789175677.574576:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1789175677.574582:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2356:x1876086251173120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175677.574604:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2356:x1876086251173120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175677.574620:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1789175677.574632:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1789175677.578671:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175677.578690:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2356:x1876086251173632:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175677.578796:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2356:x1876086251173632:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 110us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175677.578805:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:2.0:1789175677.578836:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789175677.578841:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789175677.578846:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175677.579895:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251172864 00000100:00100000:3.0:1789175677.579910:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251172864 00000100:00100000:3.0:1789175677.580045:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:3.0:1789175677.580057:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2356:x1876086251172864:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1789175677.580133:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2356:x1876086251172864:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 78us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175677.580143:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:1.0:1789175677.581508:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2355:x1876086251173248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175677.581949:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2355:x1876086251173248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 7309us (8136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175677.581960:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:3.0:1789175678.500095:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789175679.178115:0:16483:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff85ba8550 20000000:00000080:1.0:1789175679.178219:0:16483:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97e601cfb000 uarg=0000000000000000 20000000:01000000:1.0:1789175679.178406:0:16483:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789175679.178415:0:16483:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789175679.178421:0:16483:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789175679.183562:0:16484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789175679.188838:0:16483:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789175679.197608:0:16483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789175679.197733:0:16483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197780:0:16483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197789:0:16483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197865:0:16483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197876:0:16483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197884:0:16483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197892:0:16483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197956:0:16483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.197975:0:16483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 12 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.197996:0:16483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230144:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175679.198298:0:16483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.198309:0:16483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.198326:0:16483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230272:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175679.198867:0:16483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.198877:0:16483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 18 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.198889:0:16483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230400:0@lo:104: 00000100:00100000:0.0:1789175679.199958:0:16483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789175679.200064:0:16483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.200079:0:16483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.200093:0:16483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230528:0@lo:104: 00000100:00100000:0.0:1789175679.200116:0:16483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789175679.200332:0:16483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175679.200366:0:16483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 18 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.200376:0:16483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230656:0@lo:104: 00000100:00100000:0.0:1789175679.200406:0:16483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175679.200468:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230400 00000100:00100000:2.0:1789175679.200476:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230400 00000100:00100000:2.0:1789175679.200523:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230528 00000100:00100000:2.0:1789175679.200534:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230528 00000100:00100000:2.0:1789175679.200550:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175679.200560:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+4:16483:x1876086274230400:12345-0@lo:104: 00010000:00010000:2.0:1789175679.200576:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175679.200666:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175679.200673:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+4:16483:x1876086274230400:12345-0@lo:104: Request processed in 114us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175679.200680:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789175679.200699:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175679.200705:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:16483:x1876086274230528:12345-0@lo:104: 00010000:00010000:2.0:1789175679.200713:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175679.200845:0:16483:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e601926d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789175679.200871:0:16483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230400:0@lo:104: 00000100:00100000:0.0:1789175679.200879:0:16483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230528:0@lo:104: 00010000:00010000:3.0:1789175679.200966:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789175679.200975:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.200984:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175679.200988:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.200999:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175679.201016:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175679.201022:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175679.201072:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201079:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175679.201106:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201115:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5000/0x1112cdeac4c178c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c178c7 expref: -99 pid: 15771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201140:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175679.201144:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201151:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175679.201154:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201161:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175679.201166:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175679.201172:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175679.201187:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201192:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175679.201198:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201215:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e72e1b4200/0x1112cdeac4c1778c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17793 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201225:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175679.201241:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175679.201244:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175679.201262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274230784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175679.201302:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175679.201329:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789175679.201334:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274230912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175679.201382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175679.201423:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230784 00000100:00100000:3.0:1789175679.201428:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230784 00010000:00010000:3.0:1789175679.201453:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 19 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.201476:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230912 00000100:00100000:3.0:1789175679.201479:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230912 00010000:00010000:3.0:1789175679.201492:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 20 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.201504:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175679.201510:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+20:3306:x1876086274230784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175679.201521:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175679.201526:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 20 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201537:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 20 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201560:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e705668400/0x1112cdeac4c178c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c178c0 expref: 20 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201575:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175679.201604:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+19:3306:x1876086274230784:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175679.201611:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789175679.201630:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175679.201636:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+18:3306:x1876086274230912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175679.201644:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175679.201649:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201657:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201668:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17793 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1778c expref: 18 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.201677:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175679.201698:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+17:3306:x1876086274230912:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175679.201704:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789175679.201741:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274230912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175679.201750:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71fe837c-1812-4075-866f-5d0b367ca590:3306:1876086274230784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789175679.202709:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789175679.202726:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:16483:x1876086274230528:12345-0@lo:104: Request processed in 2016us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175679.202737:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789175679.202762:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274230656 00000100:00100000:2.0:1789175679.202768:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274230656 00000100:00100000:2.0:1789175679.202807:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789175679.202817:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73fb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:16483:x1876086274230656:12345-0@lo:104: 00010000:00010000:2.0:1789175679.202832:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175679.202909:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789175679.202914:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73fb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:71fe837c-1812-4075-866f-5d0b367ca590+3:16483:x1876086274230656:12345-0@lo:104: Request processed in 100us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175679.202933:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789175679.203205:0:16483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230656:0@lo:104: 00010000:00010000:3.0:1789175679.203451:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175679.203466:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.203474:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e705669e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1789175679.203478:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.203487:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789175679.203495:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175679.203501:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789175679.203552:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.203560:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789175679.203588:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.203596:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff97e705669e00/0x1112cdeac4c1773f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1112cdeac4c17746 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.203617:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175679.203619:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175679.203621:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175679.203650:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71fe837c-1812-4075-866f-5d0b367ca590:3304:1876086274231040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789175679.203704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789175679.203758:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175679.203771:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231040 00000100:00100000:3.0:1789175679.203783:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231040 00010000:00010000:3.0:1789175679.204003:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 17 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.204044:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175679.204054:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+17:3304:x1876086274231040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789175679.204069:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175679.204075:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 17 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.204087:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 17 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.204102:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654a800/0x1112cdeac4c17746 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1112cdeac4c1773f expref: 17 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.204120:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175679.204217:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71fe837c-1812-4075-866f-5d0b367ca590+16:3304:x1876086274231040:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175679.204423:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175679.204701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175679.204743:0:16483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230144:192.168.201.18@tcp:104: 00000100:00100000:1.0:1789175679.204753:0:16483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16483:1876086274230272:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175679.204791:0:16483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.204976:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789175679.205086:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173760 00000100:00100000:3.0:1789175679.205091:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173760 00010000:00010000:3.0:1789175679.205111:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 13 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.205125:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251173888 00000100:00100000:3.0:1789175679.205192:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251173888 00010000:00010000:3.0:1789175679.205210:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 14 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175679.205293:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175679.205316:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+14:2353:x1876086251173760:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175679.205329:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175679.205334:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 14 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205377:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 14 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205393:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654b600/0x1112cdeac4c17a25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fea expref: 14 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205407:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175679.205525:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2353:x1876086251173760:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 211us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175679.205532:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1789175679.205546:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1789175679.205552:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:2353:x1876086251173888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175679.205560:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175679.205564:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205573:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205584:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e72654aa00/0x1112cdeac4c179ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2f88 expref: 12 pid: 14362 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205596:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205611:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205627:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205635:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205642:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205649:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205655:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175679.205660:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205668:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205686:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.205696:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175679.205713:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:2353:x1876086251173888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 161us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175679.205718:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1789175679.205776:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71fe837c-1812-4075-866f-5d0b367ca590:3304:1876086274231040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789175679.205998:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:1.0:1789175679.206153:0:16483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175679.206163:0:16483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175679.206170:0:16483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97e6025a7a00/0x1112cdeac4c17a4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175679.521844:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175680.548361:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789175680.929677:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274231168:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.929801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.929863:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274231680:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.929906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.929944:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789175680.929951:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274231552:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.929989:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175680.929990:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231168 00000100:00100000:1.0:1789175680.930000:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231168 00000100:00100000:2.0:1789175680.930023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231296:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930058:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175680.930069:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789175680.930079:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274231808:0@lo:400:kworker.0 00000100:00100000:1.0:1789175680.930085:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:3305:x1876086274231168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.930135:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789175680.930140:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231424:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.930178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175680.930200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.930234:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231680 00000100:00100000:2.0:1789175680.930237:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231680 00000100:00100000:2.0:1789175680.930283:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231552 00000100:00100000:2.0:1789175680.930286:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231552 00000100:00100000:2.0:1789175680.930316:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231808 00000100:00100000:2.0:1789175680.930319:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231808 00000100:00100000:2.0:1789175680.930369:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789175680.930378:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274231680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930424:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876086274231680:12345-0@lo:400:kworker.0 Request processed in 48us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175680.930442:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789175680.930464:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789175680.930470:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274231552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930499:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274231552:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175680.930505:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789175680.930518:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175680.930524:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e603909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274231808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175680.930749:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231296 00000100:00100000:0.0:1789175680.930754:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231296 00000100:00100000:0.0:1789175680.930789:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231424 00000100:00100000:0.0:1789175680.930793:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231424 00000100:00100000:0.0:1789175680.930818:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789175680.930827:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.930994:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e603909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876086274231808:12345-0@lo:400:kworker.0 Request processed in 470us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175680.931001:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789175680.931030:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175680.931038:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.931073:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231424:12345-0@lo:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175680.931080:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175680.931103:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274231936 00000100:00100000:2.0:1789175680.931107:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274231936 00000100:00100000:2.0:1789175680.931130:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789175680.931137:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175680.931172:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175680.931207:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175680.931215:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789175680.931233:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789175680.931245:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789175680.931249:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175680.931316:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231424:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.931366:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789175680.931383:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1876086274231808:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.931427:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274231552:0@lo:400:kworker.0 00000100:00100000:2.0:1789175680.931451:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1876086274231680:0@lo:400:kworker.0 00000100:00100000:1.0:1789175680.932218:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+16:3305:x1876086274231168:12345-0@lo:400:kworker.0 Request processed in 2132us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175680.932231:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789175680.932383:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71fe837c-1812-4075-866f-5d0b367ca590:3305:1876086274231168:0@lo:400:kworker.0 00000100:00100000:0.0:1789175680.935420:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274231296:12345-0@lo:400:kworker.0 Request processed in 4579us (5345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175680.935451:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789175680.935605:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274231296:0@lo:400:kworker.0 10000000:01000000:2.0:1789175680.993626:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789175680.993645:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7030e5800 from 10 10000000:01000000:2.0:1789175680.993655:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789175680.993745:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175680.993762:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175680.993779:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175680.993822:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789175680.993950:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175680.994020:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7283f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789175680.994103:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232064 00000100:00100000:1.0:1789175680.994113:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232064 00000100:00100000:1.0:1789175680.995415:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789175680.995433:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+16:14364:x1876086274232064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175680.995464:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175680.995498:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654ba00/0x1112cdeac4c17a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17a56 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175680.995563:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654ba00/0x1112cdeac4c17a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17a56 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175680.995582:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654ba00/0x1112cdeac4c17a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17a56 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175680.995597:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654ba00, rc 0) 00000100:00100000:1.0:1789175680.995719:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175680.995729:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789175680.995777:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175680.995808:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a5d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175680.995823:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17a5d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175680.995936:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175680.995991:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175680.996036:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175680.996679:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232192 00000100:00100000:1.0:1789175680.996689:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232192 00000100:00100000:1.0:1789175680.996752:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789175680.996760:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789175680.997271:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 510us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175680.997280:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789175680.997403:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175680.997466:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175680.997534:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175680.997579:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175680.998006:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232320 00000100:00100000:1.0:1789175680.998013:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232320 00000100:00100000:1.0:1789175680.998058:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789175680.998067:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789175680.998313:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175680.998322:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789175680.998512:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789175681.000643:0:16563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789175681.001946:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789175681.002017:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789175681.002032:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a5d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175681.002049:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e72e1b5400/0x1112cdeac4c17a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a5d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789175681.002062:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789175681.002066:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e7082ce000 from 10 10000000:01000000:0.0:1789175681.002069:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789175681.002176:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175681.002186:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175681.002198:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175681.002557:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.005600:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175681.005911:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1789175681.006058:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232448 00000100:00100000:1.0:1789175681.006072:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232448 00000100:00100000:1.0:1789175681.006255:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789175681.006269:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+17:14364:x1876086274232448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175681.006304:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175681.006335:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654a000/0x1112cdeac4c17a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17a64 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.006416:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654a000/0x1112cdeac4c17a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17a64 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.006430:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654a000/0x1112cdeac4c17a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17a64 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.006442:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654a000, rc 0) 00000100:00100000:1.0:1789175681.006525:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175681.006555:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789175681.006662:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175681.006685:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a6b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175681.006695:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17a6b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175681.006812:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.006858:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175681.008959:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff840 going to sleep for 11 seconds 00000100:00100000:3.0:1789175681.009045:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232576 00000100:00100000:3.0:1789175681.009057:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232576 00000100:00100000:3.0:1789175681.009199:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789175681.009224:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175681.010306:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1078us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175681.010320:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789175681.010916:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.011005:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.011090:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175681.011770:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1789175681.011912:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232704 00000100:00100000:2.0:1789175681.011921:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232704 00000100:00100000:2.0:1789175681.011985:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789175681.011995:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175681.012323:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 329us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175681.012332:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789175681.012425:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c013b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789175681.014027:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789175681.014895:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789175681.014932:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789175681.014949:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a6b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175681.014964:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e6025a7e00/0x1112cdeac4c17a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a6b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789175681.014989:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789175681.014992:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97e73474e000 from 10 10000000:01000000:3.0:1789175681.014996:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789175681.015057:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175681.015066:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175681.015079:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175681.020000:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789175681.020192:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175681.020400:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73c52aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789175681.020647:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232832 00000100:00100000:2.0:1789175681.020660:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232832 00000100:00100000:2.0:1789175681.022068:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789175681.022109:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+18:14364:x1876086274232832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789175681.022142:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175681.022173:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72e1b5200/0x1112cdeac4c17a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1112cdeac4c17a72 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175681.022225:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72e1b5200/0x1112cdeac4c17a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1112cdeac4c17a72 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175681.022241:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72e1b5200/0x1112cdeac4c17a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1112cdeac4c17a72 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175681.022254:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5200, rc 0) 00000100:00100000:2.0:1789175681.022604:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274232832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 518us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175681.022613:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789175681.022763:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789175681.022788:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a79 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175681.022800:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1112cdeac4c17a79 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175681.022913:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.022954:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175681.025426:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789175681.025671:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274232960 00000100:00100000:3.0:1789175681.025687:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274232960 00000100:00100000:3.0:1789175681.025792:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789175681.025806:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274232960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789175681.026619:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274232960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 813us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175681.026630:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789175681.026842:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274232960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.026921:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274233088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.026990:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175681.027030:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789175681.027046:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274233088 00000100:00100000:0.0:1789175681.027052:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274233088 00000100:00100000:0.0:1789175681.027083:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789175681.027090:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274233088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.027679:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:14364:x1876086274233088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 586us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175681.027712:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789175681.027770:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:71fe837c-1812-4075-866f-5d0b367ca590:14364:1876086274233088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789175681.029590:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789175681.031694:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789175681.031917:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789175681.031934:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a79 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175681.031970:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff97e700031a00/0x1112cdeac4c17a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1112cdeac4c17a79 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175681.092285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175681.092402:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174016 00000100:00100000:1.0:1789175681.092416:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174016 00000100:00100000:1.0:1789175681.092503:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:1.0:1789175681.092518:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+11:13776:x1876086251174016:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175681.092551:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175681.092581:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17a80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c301b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.092623:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c301b expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.092637:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654bc00/0x1112cdeac4c17a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c301b expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.092648:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654bc00, rc 0) 00000100:00100000:1.0:1789175681.092845:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174016:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 330us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175681.092853:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1789175681.095270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175681.095372:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174144 00000100:00100000:0.0:1789175681.095386:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174144 00000100:00100000:0.0:1789175681.095449:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:0.0:1789175681.095461:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174144:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.095886:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174144:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 427us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175681.095897:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:0.0:1789175681.097815:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175681.097902:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174272 00000100:00100000:2.0:1789175681.097914:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174272 00000100:00100000:2.0:1789175681.097983:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:2.0:1789175681.097994:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174272:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789175681.098278:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174272:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 285us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175681.098288:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:0.0:1789175681.120825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175681.120922:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174400 00000100:00100000:1.0:1789175681.120936:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174400 00000100:00100000:1.0:1789175681.121021:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:1.0:1789175681.121035:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+12:13776:x1876086251174400:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789175681.121059:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175681.121088:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97e72654b400/0x1112cdeac4c17a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3022 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.121139:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97e72654b400/0x1112cdeac4c17a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3022 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.121153:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97e72654b400/0x1112cdeac4c17a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3022 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175681.121166:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b400, rc 0) 00000100:00100000:1.0:1789175681.121257:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13776:x1876086251174400:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 224us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175681.121266:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:3.0:1789175681.124453:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175681.124661:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174528 00000100:00100000:0.0:1789175681.124674:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174528 00000100:00100000:0.0:1789175681.124748:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1789175681.124762:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13776:x1876086251174528:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789175681.125163:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13776:x1876086251174528:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 403us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175681.125173:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1789175681.131193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175681.131305:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174656 00000100:00100000:3.0:1789175681.131323:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174656 00000100:00100000:3.0:1789175681.131662:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:3.0:1789175681.131677:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13776:x1876086251174656:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789175681.132034:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:13776:x1876086251174656:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 360us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175681.132044:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:0.0:1789175681.443252:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789175681.443295:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274233216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789175681.443686:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175681.443855:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274233216 00000100:00100000:2.0:1789175681.443867:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274233216 00000100:00100000:2.0:1789175681.443939:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789175681.443952:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274233216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789175681.444010:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789175681.444069:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274233216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175681.444077:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789175681.444177:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274233216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789175681.569783:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789175682.018148:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789175682.593637:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175682.630029:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.630380:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251174784 00000100:00100000:0.0:1789175682.630395:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251174784 00000100:00100000:0.0:1789175682.630505:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175682.630519:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:14432:x1876086251174784:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789175682.630545:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175682.630575:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17a8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3029 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630660:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630681:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630696:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630713:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630721:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.630728:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789175682.631214:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789175682.631424:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6800/0x1112cdeac4c17aa3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631449:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6800/0x1112cdeac4c17aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631457:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6800/0x1112cdeac4c17aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175682.631493:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175682.631497:0:14399:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175682.631541:0:14399:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6800/0x1112cdeac4c17aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631554:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631560:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631567:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631574:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175682.631579:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631586:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631600:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175682.631603:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.631609:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631627:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631645:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631651:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631657:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631661:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175682.631664:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631670:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631677:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97e7102ec200) 00010000:00010000:0.0:1789175682.631680:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.631683:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631688:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17a9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631731:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3029 expref: 8 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631763:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6800/0x1112cdeac4c17aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3029 expref: 7 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.631772:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7102ecb00) 00010000:00010000:0.0:1789175682.631774:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175682.631777:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a6800, rc 0) 00000100:00100000:0.0:1789175682.631878:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:14432:x1876086251174784:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1361us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.631887:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175682.638029:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.638275:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175040 00000100:00100000:2.0:1789175682.638289:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175040 00000100:00100000:2.0:1789175682.638447:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1789175682.638462:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:14432:x1876086251175040:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175682.638491:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.638519:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17aaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3030 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638642:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638672:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638693:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638873:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638902:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.638917:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.640018:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17abf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.640040:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17abf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.640051:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17abf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.640066:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789175682.641190:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641213:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641220:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641226:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.641231:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641238:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641261:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97e7102ecb00) 00010000:00010000:2.0:1789175682.641264:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.641269:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641275:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17ab1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641288:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641293:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641298:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641303:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.641311:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641317:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641326:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97e7181cdf00) 00010000:00010000:2.0:1789175682.641328:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.641331:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641337:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ab8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641932:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17aaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3030 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641962:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4400/0x1112cdeac4c17abf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3030 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.641970:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e7181cd900) 00010000:00010000:2.0:1789175682.641972:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.641974:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4400, rc 0) 00000100:00100000:2.0:1789175682.642057:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14432:x1876086251175040:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3598us (4044us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789175682.642066:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1789175682.645592:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.646622:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175168 00000100:00100000:0.0:1789175682.646640:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175168 00000100:00100000:0.0:1789175682.646723:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1789175682.646736:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14432:x1876086251175168:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789175682.646883:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14432:x1876086251175168:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 142us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.646891:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1789175682.695847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.696805:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175296 00000100:00100000:0.0:1789175682.696824:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175296 00000100:00100000:0.0:1789175682.696909:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:0.0:1789175682.696922:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2353:x1876086251175296:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175682.697039:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2353:x1876086251175296:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 120us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.697055:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1789175682.699670:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.699796:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175424 00000100:00100000:2.0:1789175682.699809:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175424 00000100:00100000:2.0:1789175682.699894:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1789175682.699906:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2353:x1876086251175424:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175682.700016:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2353:x1876086251175424:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 112us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.700025:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00080000:3.0:1789175682.700683:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175682.700782:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.700824:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.700856:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.700887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.700913:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175936 00000100:00100000:0.0:1789175682.700925:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175936 00000100:00100000:0.0:1789175682.700976:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175552 00000100:00100000:0.0:1789175682.700980:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175552 00000100:00100000:0.0:1789175682.700995:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175808 00000100:00100000:0.0:1789175682.700997:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175808 00000100:00100000:0.0:1789175682.701017:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1789175682.701025:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251175936:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175682.701093:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251175936:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.701216:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1789175682.701235:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175682.701242:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251175552:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175682.701269:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251175552:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.701275:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175682.701285:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175682.701291:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251175808:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175682.701312:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251175808:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.701318:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:2.0:1789175682.701429:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251175680 00000100:00100000:2.0:1789175682.701435:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251175680 00000100:00100000:2.0:1789175682.701482:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1789175682.701490:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2354:x1876086251175680:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1789175682.701524:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2354:x1876086251175680:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 35us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.701532:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00080000:3.0:1789175682.701916:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789175682.701922:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789175682.701924:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175682.708129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.708299:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176064 00000100:00100000:0.0:1789175682.708331:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176064 00000100:00100000:0.0:1789175682.708435:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1789175682.708449:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14438:x1876086251176064:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175682.708477:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175682.708504:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17acd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3037 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.708589:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.708608:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.708624:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.708642:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.708650:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710093:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710397:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710408:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710416:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710431:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175682.710436:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710444:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710465:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175682.710469:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.710475:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710481:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710501:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710507:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710514:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710519:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175682.710522:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710528:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710548:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97e7102ec200) 00010000:00010000:0.0:1789175682.710551:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.710554:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710561:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17adb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710622:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17acd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3037 expref: 10 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710635:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175682.710637:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.710641:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3037 expref: 10 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.710652:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a6c00, rc 0) 00000100:00100000:0.0:1789175682.710755:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14438:x1876086251176064:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2307us (2638us total) trans 0 rc 301/301 00000100:00100000:0.0:1789175682.710765:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1789175682.715479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.715641:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176192 00000100:00100000:0.0:1789175682.715655:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176192 00000100:00100000:0.0:1789175682.715749:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1789175682.715764:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14438:x1876086251176192:12345-192.168.201.18@tcp:700:lfs.0 00000100:00100000:0.0:1789175682.715936:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14438:x1876086251176192:12345-192.168.201.18@tcp:700:lfs.0 Request processed in 175us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.715944:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1789175682.723903:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.724163:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176448 00000100:00100000:2.0:1789175682.724180:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176448 00000100:00100000:2.0:1789175682.724262:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1789175682.724275:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14438:x1876086251176448:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:2.0:1789175682.724387:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175682.724426:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17a10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c2fb2 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.724454:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.724460:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175682.724775:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.724794:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 5 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.724805:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.724860:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 5 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.724878:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 5 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175682.724897:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274233344:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175682.726279:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7283f5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789175682.731330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.731666:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274233344:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175682.731708:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175682.731884:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176576 00000100:00100000:3.0:1789175682.731894:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176576 00010000:00010000:3.0:1789175682.731942:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 6 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175682.732012:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1789175682.732024:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2353:x1876086251176576:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175682.732303:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175682.732313:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 6 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732329:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 6 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732394:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17a48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3014 expref: 6 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732419:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:3.0:1789175682.732425:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732436:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732468:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175682.732503:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175682.732584:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2353:x1876086251176576:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 561us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175682.732592:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00010000:00010000:2.0:1789175682.732848:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.732857:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.732888:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.732899:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.732907:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.734550:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789175682.734583:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734595:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734603:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734609:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.734615:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734625:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734641:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.734645:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.734651:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.734658:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17ae2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175682.734683:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053e0ae0f reply state 000000006bfc7300 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175682.734693:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175682.734831:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+10:14438:x1876086251176448:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 10554us (10952us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789175682.734842:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00010000:00010000:0.0:1789175682.738904:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.738941:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.738960:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.738967:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175682.738973:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.738983:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.739005:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97e7181cdf00) 00010000:00010000:0.0:1789175682.739009:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175682.739016:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.739024:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17ae9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175682.829530:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.829777:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176704 00000100:00100000:2.0:1789175682.829813:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176704 00000100:00100000:2.0:1789175682.829908:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:2.0:1789175682.829920:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:14446:x1876086251176704:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:2.0:1789175682.829961:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.829997:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c303e expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830118:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17af7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830138:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830155:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.830210:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175682.830214:0:14399:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175682.830268:0:14399:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17af7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830302:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c303e expref: 11 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830326:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4c00/0x1112cdeac4c17af7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c303e expref: 10 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.830338:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.830412:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175682.830417:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4c00, rc 0) 00000100:00100000:2.0:1789175682.830768:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+10:14446:x1876086251176704:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 848us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.830778:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1789175682.862541:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175682.863112:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176832 00000100:00100000:0.0:1789175682.863127:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176832 00000100:00100000:0.0:1789175682.863213:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:0.0:1789175682.863226:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+5:14447:x1876086251176832:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175682.863256:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175682.863289:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3045 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863687:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863712:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863730:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175682.863786:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175682.863791:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175682.863823:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863860:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6e00/0x1112cdeac4c17afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3045 expref: 7 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863889:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6600/0x1112cdeac4c17b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3045 expref: 6 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175682.863900:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175682.863903:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789175682.863908:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a6600, rc 0) 00000100:00100000:0.0:1789175682.864244:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+6:14447:x1876086251176832:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1019us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175682.864256:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1789175682.871940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.872186:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251176960 00000100:00100000:2.0:1789175682.872199:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251176960 00000100:00100000:2.0:1789175682.872279:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1789175682.872292:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+6:14447:x1876086251176960:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175682.872320:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.872383:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c304c expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872485:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872505:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872521:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872541:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872548:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872556:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872852:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872899:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.872914:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.872988:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175682.872992:0:14399:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175682.873017:0:14399:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873034:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873040:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873047:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873053:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.873058:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873067:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873081:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.873084:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.873089:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873106:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873124:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873131:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873136:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873140:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.873143:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873149:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873156:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97e7181cd400) 00010000:00010000:2.0:1789175682.873159:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.873161:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873167:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873704:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c304c expref: 8 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873741:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c304c expref: 7 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.873749:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd000) 00010000:00010000:2.0:1789175682.873753:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175682.873756:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5e00, rc 0) 00000100:00100000:2.0:1789175682.874091:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+7:14447:x1876086251176960:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1799us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.874100:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1789175682.883686:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.883770:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251177216 00000100:00100000:2.0:1789175682.883780:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251177216 00000100:00100000:2.0:1789175682.883840:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1789175682.883853:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+7:14447:x1876086251177216:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175682.883876:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.883897:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3053 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.884006:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789175682.884241:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3053 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.884256:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.884259:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175682.884263:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3053 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.884290:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5a00, rc 0) 00000100:00100000:2.0:1789175682.884444:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+8:14447:x1876086251177216:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 596us (765us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789175682.884450:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1789175682.890984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.891095:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251177472 00000100:00100000:2.0:1789175682.891106:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251177472 00000100:00100000:2.0:1789175682.891171:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:2.0:1789175682.891183:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+8:14447:x1876086251177472:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:2.0:1789175682.891246:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175682.891274:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c304c expref: 8 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.891293:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd000) 00010000:00010000:2.0:1789175682.891305:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175682.891328:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.891392:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.891405:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175682.891650:0:14368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074245979 reply state 0000000026073a13 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175682.891660:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789175682.891682:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789175682.891771:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+9:14447:x1876086251177472:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 589us (797us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789175682.891779:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00010000:00010000:2.0:1789175682.893653:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893667:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893672:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893676:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.893679:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893685:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893699:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:2.0:1789175682.893701:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789175682.893705:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.893709:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175682.894039:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.894101:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251177728 00000100:00100000:2.0:1789175682.894110:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251177728 00000100:00100000:2.0:1789175682.894148:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1789175682.894154:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+8:14447:x1876086251177728:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1789175682.894397:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+9:14447:x1876086251177728:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 242us (360us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789175682.894405:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1789175682.899148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.899275:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251177984 00000100:00100000:2.0:1789175682.899287:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251177984 00000100:00100000:2.0:1789175682.899415:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:2.0:1789175682.899427:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+9:14447:x1876086251177984:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175682.899451:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.899474:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c305a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899569:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899588:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899603:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899618:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899625:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.899631:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.899748:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789175682.900099:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900109:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900115:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900121:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.900126:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900133:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900147:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.900150:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.900156:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900162:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900175:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900181:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900188:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900204:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175682.900208:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900214:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900222:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97e7181cd000) 00010000:00010000:2.0:1789175682.900224:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175682.900227:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900232:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900279:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c305a expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900289:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:2.0:1789175682.900291:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175682.900295:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c305a expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.900305:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5e00, rc 0) 00000100:00100000:2.0:1789175682.900422:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+10:14447:x1876086251177984:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 996us (1282us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789175682.900430:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1789175682.906904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.907023:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251178112 00000100:00100000:2.0:1789175682.907112:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251178112 00000100:00100000:2.0:1789175682.907180:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1789175682.907191:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+10:14447:x1876086251178112:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175682.907218:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175682.907246:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3061 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907485:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907501:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907514:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175682.907546:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789175682.907550:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175682.907570:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907600:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907619:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175682.907629:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:2.0:1789175682.907631:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789175682.907635:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175682.907699:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2aabdb8c-432a-4341-b40b-231e660be0f4+11:14447:x1876086251178112:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 510us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.907707:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:1.0:1789175682.912698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175682.913026:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251178240 00000100:00100000:2.0:1789175682.913038:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251178240 00000100:00100000:2.0:1789175682.913239:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1789175682.913251:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+11:14447:x1876086251178240:12345-192.168.201.18@tcp:37:lfs.0 00000100:00100000:2.0:1789175682.924022:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2aabdb8c-432a-4341-b40b-231e660be0f4+11:14447:x1876086251178240:12345-192.168.201.18@tcp:37:lfs.0 Request processed in 10761us (11328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175682.924035:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1789175682.938445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175682.938715:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251178496 00000100:00100000:3.0:1789175682.938728:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251178496 00000100:00100000:3.0:1789175682.938796:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1789175682.938809:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e733d27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+11:14447:x1876086251178496:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175682.943697:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e733d27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+12:14447:x1876086251178496:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 4879us (5251us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789175682.943711:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1789175683.029760:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.029888:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251178624 00000100:00100000:0.0:1789175683.029902:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251178624 00000100:00100000:0.0:1789175683.029977:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1789175683.029989:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+10:14453:x1876086251178624:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175683.030011:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175683.030036:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17b67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3068 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030112:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030129:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030141:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030156:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030164:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030171:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030274:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6400/0x1112cdeac4c17b7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030283:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6400/0x1112cdeac4c17b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030306:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6400/0x1112cdeac4c17b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175683.030431:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789175683.030435:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175683.030473:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6400/0x1112cdeac4c17b7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030485:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030492:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030498:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030504:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175683.030508:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030516:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030527:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175683.030530:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175683.030535:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030541:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7c00/0x1112cdeac4c17b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030569:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030575:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030581:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030587:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7400 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175683.030590:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030598:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030605:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97e7102ec200) 00010000:00010000:0.0:1789175683.030608:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789175683.030611:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030616:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17b75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030649:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17b67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3068 expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030662:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6400/0x1112cdeac4c17b7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3068 expref: 11 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.030681:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:0.0:1789175683.030683:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789175683.030686:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a6400, rc 0) 00000100:00100000:0.0:1789175683.030759:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+11:14453:x1876086251178624:12345-192.168.201.18@tcp:101:bash.0 Request processed in 772us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.030767:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1789175683.038147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.038845:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251178880 00000100:00100000:2.0:1789175683.038856:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251178880 00000100:00100000:2.0:1789175683.038920:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1789175683.038930:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+11:14453:x1876086251178880:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1789175683.038975:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175683.038998:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c306f expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.039123:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.039139:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.039149:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.039185:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.039214:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 11 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175683.039230:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1876086274233472:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175683.039379:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7283f5a80 going to sleep for 11 seconds 00000040:00080000:0.0:1789175683.042194:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789175683.043328:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.043415:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1876086274233472:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175683.043457:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175683.044530:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251179008 00000100:00100000:3.0:1789175683.044545:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251179008 00010000:00010000:3.0:1789175683.044619:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 12 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175683.044736:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1789175683.044749:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+12:2353:x1876086251179008:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175683.044771:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175683.044779:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 12 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.044820:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 12 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.044855:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17b60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3061 expref: 12 pid: 14368 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.044893:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:3.0:1789175683.044999:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.045011:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.045022:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.045081:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175683.045270:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+11:2353:x1876086251179008:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 522us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175683.045279:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00010000:00010000:2.0:1789175683.045703:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.045717:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.045751:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.045766:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.045778:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048031:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048089:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048127:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175683.048149:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789175683.048209:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048218:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048225:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048231:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175683.048237:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048246:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048263:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:2.0:1789175683.048267:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175683.048273:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048280:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17b8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175683.048301:0:14368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f67bfdb7 reply state 000000000b4e88b1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175683.048322:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789175683.048393:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17b83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048411:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.048429:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.048431:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789175683.048434:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5600, rc 0) 00000100:00100000:2.0:1789175683.048554:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14453:x1876086251178880:12345-192.168.201.18@tcp:101:bash.0 Request processed in 9624us (10416us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789175683.048575:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:3.0:1789175683.056853:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.056881:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.056891:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.057157:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175683.057164:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.057175:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.057198:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97e7181cd000) 00010000:00010000:3.0:1789175683.057202:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789175683.057208:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.057217:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17b91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175683.063283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.063502:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251179136 00000100:00100000:0.0:1789175683.063522:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251179136 00000100:00100000:0.0:1789175683.063650:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1789175683.063666:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+13:14453:x1876086251179136:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1789175683.063704:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175683.063736:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17ba6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3076 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.063835:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.063854:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.063870:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175683.063934:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789175683.063965:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789175683.063993:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.064006:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.064038:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17ba6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.064078:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.064089:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:0.0:1789175683.064092:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789175683.064098:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7400, rc 0) 00000100:00100000:0.0:1789175683.064293:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14453:x1876086251179136:12345-192.168.201.18@tcp:101:bash.0 Request processed in 630us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.064302:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1789175683.072542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.072752:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251179392 00000100:00100000:2.0:1789175683.072764:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251179392 00000100:00100000:2.0:1789175683.072892:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1789175683.072912:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14453:x1876086251179392:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1789175683.074436:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+15:14453:x1876086251179392:12345-192.168.201.18@tcp:35:bash.0 Request processed in 1527us (1904us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789175683.074449:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1789175683.173740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.177230:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251179648 00000100:00100000:0.0:1789175683.177248:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251179648 00000100:00100000:0.0:1789175683.177335:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1789175683.177373:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+15:14463:x1876086251179648:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1789175683.177401:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175683.177424:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c307d expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175683.177546:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789175683.177709:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c307d expref: 17 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.177724:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97e7181cd300) 00010000:00010000:0.0:1789175683.177727:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175683.177733:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c307d expref: 17 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.177750:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7600, rc 0) 00000100:00100000:0.0:1789175683.177831:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+16:14463:x1876086251179648:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 462us (4102us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789175683.177839:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1789175683.187762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175683.187848:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251179904 00000100:00100000:3.0:1789175683.187860:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251179904 00000100:00100000:3.0:1789175683.187954:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175683.187967:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+16:14463:x1876086251179904:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175683.188463:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+17:14463:x1876086251179904:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 497us (710us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789175683.188471:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1789175683.231694:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.231825:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251180160 00000100:00100000:2.0:1789175683.231837:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251180160 00000100:00100000:2.0:1789175683.231919:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1789175683.231931:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+17:14466:x1876086251180160:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1789175683.231970:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175683.232012:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17bc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3084 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.232148:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17bc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.232165:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.232179:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175683.232192:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789175683.232330:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17bc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3084 expref: 20 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.232387:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3084 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.232396:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.232399:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175683.232403:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5e00, rc 0) 00000100:00100000:2.0:1789175683.232473:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14466:x1876086251180160:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 544us (789us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789175683.232481:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1789175683.236065:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.236181:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251180288 00000100:00100000:0.0:1789175683.236190:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251180288 00000100:00100000:0.0:1789175683.236261:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1789175683.236272:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14466:x1876086251180288:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1789175683.236373:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236391:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236403:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236431:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236438:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236460:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236466:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:0.0:1789175683.236471:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236479:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236492:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:0.0:1789175683.236495:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789175683.236500:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.236507:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175683.236596:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14466:x1876086251180288:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 325us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.236604:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1789175683.236740:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175683.243230:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.243529:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251180672 00000100:00100000:0.0:1789175683.243540:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251180672 00000100:00100000:0.0:1789175683.243656:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1789175683.243668:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14466:x1876086251180672:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1789175683.244625:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251180416 00000100:00100000:3.0:1789175683.244634:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251180416 00000100:00100000:3.0:1789175683.244698:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1789175683.244707:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:2353:x1876086251180416:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175683.244737:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175683.244762:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17bc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3084 expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175683.244781:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:3.0:1789175683.244787:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175683.244848:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:2353:x1876086251180416:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 143us (8109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175683.244855:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1789175683.245227:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14466:x1876086251180672:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 1560us (2007us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789175683.245236:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1789175683.554422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.554515:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251180928 00000100:00100000:2.0:1789175683.554527:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251180928 00000100:00100000:2.0:1789175683.554598:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1789175683.554610:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+19:14497:x1876086251180928:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1789175683.554655:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175683.554681:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17bde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c308b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.554810:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17be5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.554828:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.554853:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175683.554866:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789175683.555038:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5a00/0x1112cdeac4c17bde lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c308b expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.555058:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17be5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c308b expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.555068:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.555071:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175683.555075:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5000, rc 0) 00000100:00100000:2.0:1789175683.555139:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:14497:x1876086251180928:12345-192.168.201.18@tcp:101:cat.0 Request processed in 531us (728us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789175683.555147:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1789175683.560559:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175683.560595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.560708:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251181312 00000100:00100000:0.0:1789175683.560721:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251181312 00000100:00100000:0.0:1789175683.560786:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1789175683.560796:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:2353:x1876086251181312:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175683.560812:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175683.560840:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17be5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c308b expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.560863:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:0.0:1789175683.560869:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789175683.560943:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:2353:x1876086251181312:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 138us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.560950:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:2.0:1789175683.561021:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251181184 00000100:00100000:2.0:1789175683.561025:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251181184 00000100:00100000:2.0:1789175683.561054:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1789175683.561074:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:14497:x1876086251181184:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:2.0:1789175683.561394:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:14497:x1876086251181184:12345-192.168.201.18@tcp:35:cat.0 Request processed in 320us (844us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789175683.561401:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00010000:00010000:3.0:1789175683.619332:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175683.659502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.661251:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251181568 00000100:00100000:0.0:1789175683.661282:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251181568 00000100:00100000:0.0:1789175683.661371:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:0.0:1789175683.661384:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:14503:x1876086251181568:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1789175683.661410:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175683.661434:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bf3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3092 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661538:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661554:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661584:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661594:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661631:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661647:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 22 pid: 14366 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175683.661661:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14399:1876086274233600:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175683.661802:0:14399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.661812:0:14399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 22 pid: 14368 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175683.661821:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14399:1876086274233728:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175683.661844:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc98d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789175683.666885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175683.666944:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175683.667035:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251181696 00000100:00100000:1.0:1789175683.667046:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251181696 00010000:00010000:1.0:1789175683.667092:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 23 pid: 14366 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175683.667154:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251181824 00000100:00100000:1.0:1789175683.667158:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251181824 00010000:00010000:1.0:1789175683.667172:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 24 pid: 14368 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175683.667176:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1789175683.667185:0:14354:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789175683.667192:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789175683.667202:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73be10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:2353:x1876086251181696:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175683.667224:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175683.667234:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 24 pid: 14366 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.667251:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 24 pid: 14366 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.667280:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.667285:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.667294:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.667301:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175683.667335:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1789175683.667371:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:2353:x1876086251181824:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789175683.667380:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789175683.667385:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 24 pid: 14368 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175683.667388:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73be10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:2353:x1876086251181696:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 203us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175683.667395:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:1.0:1789175683.667396:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 24 pid: 14368 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.667409:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:1.0:1789175683.667413:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.667420:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.667427:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.667443:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789175683.667462:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:2353:x1876086251181824:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175683.667474:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00010000:00010000:0.0:1789175683.667779:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17bad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3076 expref: 22 pid: 14366 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175683.667796:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14399:1876086274233600:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175683.667820:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17b98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c306f expref: 21 pid: 14368 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175683.667832:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14399:1876086274233728:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175683.667853:0:14399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.667861:0:14399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.667867:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789175683.667885:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789175683.668069:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17bf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3092 expref: 22 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.668084:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7a00/0x1112cdeac4c17bfa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3092 expref: 21 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.668092:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:0.0:1789175683.668094:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789175683.668097:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7a00, rc 0) 00000100:00100000:0.0:1789175683.668139:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:14503:x1876086251181568:12345-192.168.201.18@tcp:101:dd.0 Request processed in 6759us (8650us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789175683.668147:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1789175683.673863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.674162:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182080 00000100:00100000:2.0:1789175683.674173:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182080 00000100:00100000:2.0:1789175683.674277:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1789175683.674300:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+21:14503:x1876086251182080:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:2.0:1789175683.674641:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.674661:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.674674:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789175683.674726:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789175683.674752:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1e101c4 reply state 00000000d9181695 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175683.674760:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175683.674870:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14503:x1876086251182080:12345-192.168.201.18@tcp:36:dd.0 Request processed in 570us (1016us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789175683.674877:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000020:00080000:2.0:1789175683.674882:0:14367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789175683.676610:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676625:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676634:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676640:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175683.676645:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676673:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676691:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.676694:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175683.676700:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.676706:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175683.680947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175683.685254:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182208 00000100:00100000:1.0:1789175683.685332:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182208 00000100:00100000:1.0:1789175683.685505:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:1.0:1789175683.685517:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:14503:x1876086251182208:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1789175683.685547:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175683.685574:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c3099 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.685639:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3099 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.685655:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c0f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3099 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175683.685675:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:1.0:1789175683.685679:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175683.685683:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654b600, rc 0) 00000100:00100000:1.0:1789175683.685757:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14503:x1876086251182208:12345-192.168.201.18@tcp:101:dd.0 Request processed in 242us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175683.685764:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:1.0:1789175683.700546:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175683.705085:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182464 00000100:00100000:2.0:1789175683.705101:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182464 00000100:00100000:2.0:1789175683.705191:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1789175683.705202:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14503:x1876086251182464:12345-192.168.201.18@tcp:103:dd.0 00010000:00010000:2.0:1789175683.705295:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175683.705328:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c3099 expref: 24 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175683.705376:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175683.705383:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175683.705447:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:14503:x1876086251182464:12345-192.168.201.18@tcp:103:dd.0 Request processed in 246us (4913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175683.705454:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1789175683.709062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.710835:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182592 00000100:00100000:0.0:1789175683.710850:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182592 00000100:00100000:0.0:1789175683.710952:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:0.0:1789175683.710965:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:14503:x1876086251182592:12345-192.168.201.18@tcp:58:dd.0 00010000:00010000:0.0:1789175683.711086:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.711105:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.711118:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175683.712119:0:14366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789175683.712293:0:14366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789175683.714161:0:14366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789175683.719053:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:14503:x1876086251182592:12345-192.168.201.18@tcp:58:dd.0 Request processed in 8075us (9986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.719073:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1789175683.727205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175683.727694:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182720 00000100:00100000:0.0:1789175683.727706:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182720 00000100:00100000:0.0:1789175683.727811:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:0.0:1789175683.727822:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+23:14503:x1876086251182720:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1789175683.727844:0:14399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789175683.727867:0:14399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30a0 expref: -99 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.727941:0:14399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.727953:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 24 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.727994:0:14399:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.728008:0:14399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 24 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.728024:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:0.0:1789175683.728027:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789175683.728030:0:14399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 24 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175683.728040:0:14399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e6025a7400, rc 0) 00000100:00100000:0.0:1789175683.728111:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14503:x1876086251182720:12345-192.168.201.18@tcp:101:dd.0 Request processed in 291us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175683.728118:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000040:00080000:0.0:1789175684.065719:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789175684.065729:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175684.065774:0:14401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789175684.065781:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789175684.065912:0:14401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14401:1876086274233856:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789175684.066039:0:14401:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73fc98480 going to sleep for 11 seconds 00000100:00100000:0.0:1789175684.071239:0:14401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c012d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14401:1876086274233856:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789175684.073969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.074432:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182848 00000100:00100000:2.0:1789175684.074446:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182848 00000100:00100000:2.0:1789175684.074531:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1789175684.074542:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251182848:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789175684.074652:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251182848:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 112us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.074661:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00080000:3.0:1789175684.075615:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175684.082495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.082684:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251182976 00000100:00100000:2.0:1789175684.082696:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251182976 00000100:00100000:2.0:1789175684.082773:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1789175684.082794:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251182976:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175684.082835:0:14367:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175684.083330:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251182976:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 545us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.083339:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1789175684.091337:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.091740:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251183104 00000100:00100000:2.0:1789175684.091752:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251183104 00000100:00100000:2.0:1789175684.091832:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1789175684.091844:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251183104:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.091939:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.091957:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.091972:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092028:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092036:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092067:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092089:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092097:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092103:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175684.092141:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789175684.092146:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789175684.092159:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092170:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092176:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092183:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092188:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5000 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.092192:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092200:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092217:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e7181cd900) 00010000:00010000:2.0:1789175684.092220:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.092225:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092232:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5000/0x1112cdeac4c17c24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092246:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092253:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092259:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092265:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.092268:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092273:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092280:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97e7181cd100) 00010000:00010000:2.0:1789175684.092282:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.092285:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092291:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5e00/0x1112cdeac4c17c2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092314:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092320:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092325:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092330:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.092332:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092337:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092366:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175684.092368:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.092372:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.092377:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4e00/0x1112cdeac4c17c32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.092447:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251183104:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 605us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.092454:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:3.0:1789175684.103172:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.103396:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251183360 00000100:00100000:2.0:1789175684.103409:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251183360 00000100:00100000:2.0:1789175684.103481:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:2.0:1789175684.103507:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+24:14504:x1876086251183360:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.103530:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175684.103557:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30a7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103679:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103696:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103720:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789175684.103733:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789175684.103861:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103869:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103876:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103882:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.103886:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103894:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103906:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175684.103915:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789175684.103932:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103940:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103985:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a7 expref: 26 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.103997:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97e7181cd900) 00010000:00010000:2.0:1789175684.103999:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789175684.104003:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a7 expref: 26 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.104013:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175684.104098:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+25:14504:x1876086251183360:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 593us (937us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789175684.104107:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1789175684.110509:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.110631:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251183488 00000100:00100000:2.0:1789175684.110641:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251183488 00000100:00100000:2.0:1789175684.110698:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1789175684.110724:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+25:14504:x1876086251183488:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789175684.110764:0:14368:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789175684.110886:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60390b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+25:14504:x1876086251183488:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 177us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.110893:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1789175684.117150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.117273:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251183744 00000100:00100000:2.0:1789175684.117291:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251183744 00000100:00100000:2.0:1789175684.117432:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1789175684.117443:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+25:14504:x1876086251183744:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.117466:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175684.117492:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17c4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30ae expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789175684.118636:0:14366:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1789175684.118648:0:14366:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789175684.118708:0:14366:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789175684.119271:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17c55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.119290:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.119308:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.119409:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17c4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ae expref: 28 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.119429:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17c55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ae expref: 27 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.119438:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e7181cd000) 00010000:00010000:2.0:1789175684.119441:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789175684.119444:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b5600, rc 0) 00000100:00100000:2.0:1789175684.120232:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+27:14504:x1876086251183744:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 2786us (3207us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789175684.120257:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1789175684.125625:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.125808:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184000 00000100:00100000:2.0:1789175684.125821:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184000 00000100:00100000:2.0:1789175684.125895:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1789175684.125907:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+27:14504:x1876086251184000:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.125981:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175684.126010:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b5600/0x1112cdeac4c17c55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ae expref: 27 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.126043:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e7181cd000) 00010000:00010000:2.0:1789175684.128521:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175684.128562:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.128581:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.128594:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.128989:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.128999:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.129008:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130526:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130536:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130543:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130549:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4200 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.130553:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130560:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130575:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97e7181cd400) 00010000:00010000:2.0:1789175684.130579:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.130584:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130590:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4200/0x1112cdeac4c17c63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130615:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130620:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130626:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130640:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4800 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.130643:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130649:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130656:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x79342965 (ffff97e7181cd100) 00010000:00010000:2.0:1789175684.130659:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.130661:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.130666:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x79342965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.130819:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+26:14504:x1876086251184000:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 4907us (5199us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789175684.130830:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1789175684.133846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175684.134321:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184128 00000100:00100000:3.0:1789175684.134331:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184128 00000100:00100000:3.0:1789175684.134416:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1789175684.134426:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+26:14504:x1876086251184128:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789175684.134462:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789175684.134486:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17c71 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30b5 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134524:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17c78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134539:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17c78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134551:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17c78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134762:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17c71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30b5 expref: 28 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134849:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700031000/0x1112cdeac4c17c78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30b5 expref: 27 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.134859:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:3.0:1789175684.134864:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789175684.134867:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e700031000, rc 0) 00000100:00100000:3.0:1789175684.135038:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+27:14504:x1876086251184128:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 612us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.135052:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1789175684.140806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.141254:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184384 00000100:00100000:0.0:1789175684.141265:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184384 00000100:00100000:0.0:1789175684.141444:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:0.0:1789175684.141455:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+27:14504:x1876086251184384:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789175684.141564:0:14399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.141583:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.141606:0:14399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789175684.141983:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789175684.141996:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 469100653875ns, next at 470100650671ns, rc = 0 00000004:00010000:0.0:1789175684.142107:0:14399:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011fd04ff reply state 0000000083b4be76 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175684.142118:0:14399:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789175684.142237:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+29:14504:x1876086251184384:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 783us (1444us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789175684.142247:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00010000:00010000:3.0:1789175684.147419:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147440:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147463:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147470:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6c00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:3.0:1789175684.147475:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147485:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147504:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:3.0:1789175684.147508:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789175684.147514:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.147521:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6c00/0x1112cdeac4c17c7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14399 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.148581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.149549:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184512 00000100:00100000:2.0:1789175684.149562:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184512 00000100:00100000:2.0:1789175684.149643:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1789175684.149655:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+28:14504:x1876086251184512:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.149683:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175684.149708:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30bc expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.149773:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 29 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.149817:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 29 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.149840:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:2.0:1789175684.149844:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789175684.149848:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4800, rc 0) 00000100:00100000:2.0:1789175684.149948:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+29:14504:x1876086251184512:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 268us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.149956:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1789175684.156136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.156514:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184640 00000100:00100000:2.0:1789175684.156525:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184640 00000100:00080000:3.0:1789175684.156677:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789175684.156766:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1789175684.156792:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2353:x1876086251184640:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789175684.157242:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2353:x1876086251184640:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 463us (1120us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789175684.157251:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1789175684.162861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.163949:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251184896 00000100:00100000:2.0:1789175684.163962:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251184896 00000100:00100000:2.0:1789175684.164042:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1789175684.164053:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+29:14504:x1876086251184896:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789175684.164313:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+30:14504:x1876086251184896:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 261us (1466us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789175684.164321:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1789175684.167455:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.167573:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185152 00000100:00100000:2.0:1789175684.167660:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185152 00000100:00100000:2.0:1789175684.167832:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1789175684.167845:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+30:14504:x1876086251185152:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789175684.167981:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+30:14504:x1876086251185152:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 138us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.167990:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1789175684.172894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175684.173066:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185280 00000100:00100000:1.0:1789175684.173087:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185280 00000100:00100000:1.0:1789175684.173167:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1789175684.173181:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+30:14504:x1876086251185280:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789175684.173214:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789175684.173251:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30c3 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173403:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173425:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173440:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789175684.173493:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789175684.173523:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173555:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654b600/0x1112cdeac4c17c8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30c3 expref: 32 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173578:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30c3 expref: 31 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.173612:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:1.0:1789175684.173615:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789175684.173620:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72654aa00, rc 0) 00000100:00100000:1.0:1789175684.173692:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+31:14504:x1876086251185280:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 513us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175684.173699:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1789175684.178033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.178199:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185408 00000100:00100000:2.0:1789175684.178221:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185408 00000100:00100000:2.0:1789175684.178315:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1789175684.178326:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+6:2354:x1876086251185408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.178386:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175684.178410:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30ca expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789175684.178440:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a784, blocks: 0x1 00010000:00010000:2.0:1789175684.178460:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=469s v=(0 0) 00010000:00010000:2.0:1789175684.178465:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.178476:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 7 pid: 15051 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.178496:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 7 pid: 15051 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.178511:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4200, rc 0) 00000100:00100000:2.0:1789175684.178579:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e7075ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2354:x1876086251185408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 255us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.178615:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175684.185315:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.185562:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185664 00000100:00100000:0.0:1789175684.185577:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185664 00000100:00100000:0.0:1789175684.185745:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1789175684.185766:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+31:14504:x1876086251185664:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789175684.185896:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+31:14504:x1876086251185664:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 141us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175684.185904:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1789175684.190206:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175684.191430:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185792 00000100:00100000:1.0:1789175684.191444:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185792 00000100:00100000:1.0:1789175684.191514:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1789175684.191525:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+31:14504:x1876086251185792:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789175684.350081:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1789175684.350100:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789175684.350135:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1789175684.350178:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789175684.350219:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789175684.350684:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789175684.350712:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274233984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789175684.350807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175684.351034:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274233984 00000100:00100000:2.0:1789175684.351043:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274233984 00000100:00100000:2.0:1789175684.351119:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789175684.351129:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274233984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789175684.351371:0:16244:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789175684.351375:0:16244:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789175684.351377:0:16244:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789175684.351380:0:16244:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789175684 -> 1789175684 00002000:00010000:2.0:1789175684.351382:0:16244:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789175684.351427:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876086274233984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (620us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789175684.351434:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789175684.352221:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789175684.352277:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97e60365c700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789175684.352288:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274233984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789175684.352958:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14504:x1876086251185792:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 161427us (162756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.352970:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1789175684.360468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175684.361710:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251185920 00000100:00100000:3.0:1789175684.361733:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251185920 00000100:00100000:3.0:1789175684.361827:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1789175684.361942:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2353:x1876086251185920:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789175684.362508:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2353:x1876086251185920:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 568us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.362518:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1789175684.366947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.367743:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186176 00000100:00100000:2.0:1789175684.367760:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186176 00000100:00100000:2.0:1789175684.367854:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1789175684.367869:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14504:x1876086251186176:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.367958:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175684.367994:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72654aa00/0x1112cdeac4c17c94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30c3 expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.368020:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:2.0:1789175684.368055:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789175684.368101:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.368118:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.368130:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789175684.369118:0:14368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9f5a9b3 reply state 00000000e95ac0d1 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.369135:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789175684.369654:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+15:14504:x1876086251186176:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1784us (2732us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789175684.369663:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00010000:00010000:2.0:1789175684.373830:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373867:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373876:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373884:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.373890:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373901:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373964:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:2.0:1789175684.373967:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.373975:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.373983:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17ca2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175684.374106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.374193:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186304 00000100:00100000:2.0:1789175684.374218:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186304 00000100:00100000:2.0:1789175684.374296:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1789175684.374308:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:14504:x1876086251186304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789175684.374333:0:16244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789175684.374381:0:16244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0b8a1cf619c30d1 expref: -99 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.374423:0:16244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.374434:0:16244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.374440:0:16244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.374446:0:16244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 8 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.374507:0:16244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.374540:0:16244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.374558:0:16244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16244:1876086274234112:192.168.201.18@tcp:104: 00000100:00100000:2.0:1789175684.374698:0:16244:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff600 going to sleep for 11 seconds 00000100:00100000:2.0:1789175684.383878:0:16244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16244:1876086274234112:192.168.201.18@tcp:104: 00010000:00010000:2.0:1789175684.383940:0:16244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 8 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.383970:0:16244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97e72e1b4e00, rc 0) 00000100:00100000:2.0:1789175684.384072:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:14504:x1876086251186304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 9765us (9972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.384084:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1789175684.384949:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.385230:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186432 00000100:00100000:2.0:1789175684.385242:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186432 00010000:00010000:2.0:1789175684.385300:0:16597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.385379:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1789175684.385393:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2354:x1876086251186432:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789175684.385412:0:16597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789175684.385447:0:16597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.385503:0:16597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.385533:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4999cb7/0x1112cdeac4c17c9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30ca expref: 8 pid: 15051 timeout: 569 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.385556:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.385562:0:16597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.385570:0:16597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 7 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.385582:0:16597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 7 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.385632:0:16597:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 7 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.385652:0:16597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16597:1876086274234240:192.168.201.18@tcp:105: 00000100:00100000:2.0:1789175684.386040:0:16597:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7267ff600 going to sleep for 11 seconds 00000100:00100000:3.0:1789175684.396335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175684.396474:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186560 00000100:00100000:1.0:1789175684.396498:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186560 00000100:00100000:1.0:1789175684.396587:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1789175684.396601:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2354:x1876086251186560:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789175684.396932:0:15051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789175684.396937:0:15051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789175684 00002000:00010000:1.0:1789175684.396940:0:15051:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789175683 00002000:00010000:1.0:1789175684.396943:0:15051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789175684 -> 1789175684 00002000:00010000:1.0:1789175684.396945:0:15051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789175684.397024:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72643c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:2354:x1876086251186560:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 425us (705us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789175684.397052:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1789175684.397461:0:16597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e60365f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16597:1876086274234240:192.168.201.18@tcp:105: 00010000:00010000:2.0:1789175684.397501:0:16597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789175684.397535:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2354:x1876086251186432:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 12144us (12592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175684.397558:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1789175684.403599:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.403947:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186688 00000100:00100000:0.0:1789175684.403961:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186688 00000100:00100000:0.0:1789175684.404052:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1789175684.404065:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2353:x1876086251186688:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789175684.404130:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.404156:0:15050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 8 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.404167:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789175684.404172:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175684.404178:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.404240:0:15050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 8 pid: 16244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.404257:0:15050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 8 pid: 16244 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175684.405101:0:15050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e73c011f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15050:1876086274234368:192.168.201.18@tcp:104: 00000100:00100000:0.0:1789175684.405554:0:15050:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7266eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1789175684.410113:0:15050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e73c011f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15050:1876086274234368:192.168.201.18@tcp:104: 00010000:00010000:1.0:1789175684.410158:0:15050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.412889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.413787:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251186816 00000100:00100000:0.0:1789175684.413801:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251186816 00010000:00010000:0.0:1789175684.413865:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 9 pid: 16244 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175684.413922:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175684.413934:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:2354:x1876086251186816:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789175684.413952:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789175684.413978:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 9 pid: 16244 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.413995:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 9 pid: 16244 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.414024:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c656e1/0x1112cdeac4c17ca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30d1 expref: 9 pid: 16244 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.414056:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175684.414061:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789175684.414069:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.414107:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.414149:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789175684.415502:0:15050:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415525:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415570:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415580:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415590:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415598:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6200 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.415603:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415614:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415657:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.415923:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046012005/0x1112cdeac4c17cb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.416020:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2353:x1876086251186688:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 11952us (12432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.416032:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1789175684.416809:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2354:x1876086251186816:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1912us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175684.416822:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1789175684.423127:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175684.423783:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187072 00000100:00100000:3.0:1789175684.423798:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187072 00000100:00100000:3.0:1789175684.423891:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:3.0:1789175684.423903:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+14:14504:x1876086251187072:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789175684.424018:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424052:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424066:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424418:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424431:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424453:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424501:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.424519:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 15 pid: 14366 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.424537:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e737cbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274234496:192.168.201.18@tcp:104: 00000100:00100000:3.0:1789175684.425994:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7396199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789175684.428593:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.428727:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e737cbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274234496:192.168.201.18@tcp:104: 00010000:00010000:0.0:1789175684.428761:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.428909:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187200 00000100:00100000:3.0:1789175684.428926:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187200 00010000:00010000:3.0:1789175684.428970:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 16 pid: 14366 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.429016:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1789175684.429026:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+16:2353:x1876086251187200:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789175684.429088:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789175684.429096:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 16 pid: 14366 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429109:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 16 pid: 14366 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429138:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4800/0x1112cdeac4c17c86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30bc expref: 16 pid: 14366 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429163:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:3.0:1789175684.429169:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429180:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429188:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.429219:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789175684.429282:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+15:2353:x1876086251187200:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 257us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.429290:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:0.0:1789175684.429697:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.429707:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789175684.429974:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789175684.430166:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789175684.430224:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789175684.430388:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14367:1876086274234624:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175684.430644:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175684.431014:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e73bef9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789175684.431909:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274234624 00000100:00100000:3.0:1789175684.431931:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274234624 00000100:00100000:3.0:1789175684.432013:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789175684.432027:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1876086274234624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789175684.432600:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1876086274234624:12345-0@lo:1000:mdt00_001.0 Request processed in 572us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.432611:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789175684.432671:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14367:1876086274234624:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789175684.433454:0:14367:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789175684.433567:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14367:1876086274234752:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789175684.433656:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175684.433707:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e7070fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789175684.434826:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274234752 00000100:00100000:2.0:1789175684.434843:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274234752 00000100:00100000:2.0:1789175684.434926:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789175684.434938:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14367:x1876086274234752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789175684.435275:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14367:x1876086274234752:12345-0@lo:1000:mdt00_001.0 Request processed in 339us (1618us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789175684.435283:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789175684.438393:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14367:1876086274234752:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789175684.438564:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438582:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438591:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438598:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030e00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175684.438604:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438614:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438635:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:1.0:1789175684.438638:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175684.438644:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438681:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030e00/0x1112cdeac4c17cbe lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438742:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438750:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438756:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438761:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a7600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:1.0:1789175684.438764:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438770:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438779:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:1.0:1789175684.438782:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789175684.438791:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438808:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438819:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.438936:0:14367:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7400/0x1112cdeac4c17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0xf0b8a1cf619c30a0 expref: 18 pid: 14399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.438956:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e458700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274234880:192.168.201.18@tcp:105: 00000100:00100000:1.0:1789175684.439206:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff97e737d0b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789175684.450873:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.451065:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e458700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1876086274234880:192.168.201.18@tcp:105: 00010000:00010000:2.0:1789175684.451106:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451119:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a7600/0x1112cdeac4c17c16 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451171:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451192:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451209:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451222:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451229:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451263:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451270:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b4a00 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.451275:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451283:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451299:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175684.451303:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789175684.451308:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451314:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e72e1b4a00/0x1112cdeac4c17cc5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451327:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451333:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451338:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451453:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030600 already unused, calling callback (ffffffffc20f54f0) 00010000:00010000:2.0:1789175684.451456:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451472:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451481:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97e7181cdd00) 00010000:00010000:2.0:1789175684.451484:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789175684.451487:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.451493:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e700030600/0x1112cdeac4c17cb7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.451879:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e73c011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+18:14504:x1876086251187072:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 27973us (28763us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789175684.451894:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000020:00080000:2.0:1789175684.451901:0:14367:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789175684.452042:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789175684.452053:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789175684.452086:0:14401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789175684.452095:0:14401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789175684.452224:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187328 00000100:00100000:3.0:1789175684.452236:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187328 00000100:00100000:3.0:1789175684.452304:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1789175684.452316:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e726477850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+18:14503:x1876086251187328:12345-192.168.201.18@tcp:49:dd.0 00000100:00100000:3.0:1789175684.452520:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e726477850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b7bd2b70-0ce4-4e4a-920a-a90831c72597+18:14503:x1876086251187328:12345-192.168.201.18@tcp:49:dd.0 Request processed in 206us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175684.452543:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1789175684.456419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.456558:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187584 00000100:00100000:0.0:1789175684.456580:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187584 00000100:00100000:0.0:1789175684.456682:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1789175684.456694:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+18:14504:x1876086251187584:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789175684.458204:0:14369:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789175684.458316:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789175684.458653:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458673:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458687:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458696:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458828:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458837:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.458880:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789175684.459030:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789175684.459039:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.459045:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e6025a6a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.459049:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.459058:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.459071:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97e720dd1700) 00010000:00010000:3.0:1789175684.459074:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789175684.459079:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.459084:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97e6025a6a00/0x1112cdeac4c17ccc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.459098:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175684.459099:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789175684.459101:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175684.459307:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:14504:x1876086251187584:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 2610us (2901us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789175684.459318:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000020:00080000:0.0:1789175684.459324:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789175684.586946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175684.587128:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187712 00000100:00100000:1.0:1789175684.587139:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187712 00000100:00100000:1.0:1789175684.587225:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1789175684.587236:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2354:x1876086251187712:12345-192.168.201.18@tcp:4:dd.0 00002000:00010000:1.0:1789175684.587289:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa4a784, atime: 0x6aa4a783, ctime: 0x6aa4a784, blocks: 0x1 00010000:00010000:1.0:1789175684.587300:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.587319:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1789175684.587323:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175684.587330:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.587388:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.589144:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1789175684.589230:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789175684.589240:0:15058:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789175684.590181:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187840 00000100:00100000:2.0:1789175684.590190:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187840 00000100:00100000:3.0:1789175684.590777:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1789175684.590789:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2355:x1876086251187840:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1789175684.590822:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.590845:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.590849:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.590856:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.590870:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.594300:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175684.594694:0:15057:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789175684.594946:0:15058:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789175684.595150:0:15057:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789175684.595363:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251187968 00000100:00100000:0.0:1789175684.595372:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251187968 00000100:00100000:3.0:1789175684.596171:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1789175684.596185:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7bd2b70-0ce4-4e4a-920a-a90831c72597+11:2353:x1876086251187968:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1789175684.596218:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.596234:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.596238:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.596244:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.596258:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.641635:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789175684.737864:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789175684.737899:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789175684.739162:0:16598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1789175684.739172:0:16598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1789175684.739189:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739203:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739213:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739221:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031400 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:0.0:1789175684.739226:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739237:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739274:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789175684.739282:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004405730e/0x1112cdeac4c17cda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789175684.739402:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+13:2355:x1876086251187840:12345-192.168.201.18@tcp:4:dd.0 Request processed in 148610us (150261us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789175684.739413:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000001:00080000:3.0:1789175684.786287:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1789175684.786311:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1789175684.786373:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:3.0:1789175684.786404:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786419:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786429:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786436:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654aa00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.786441:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786451:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786471:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.786479:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084ab8496/0x1112cdeac4c17cd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.786564:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2354:x1876086251187712:12345-192.168.201.18@tcp:4:dd.0 Request processed in 199325us (199624us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789175684.786644:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00010000:00010000:1.0:1789175684.786851:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786867:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786875:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786881:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700031600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:1.0:1789175684.786884:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786892:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786903:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.786922:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad9f95a5/0x1112cdeac4c17ce1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.786968:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2353:x1876086251187968:12345-192.168.201.18@tcp:4:dd.0 Request processed in 190787us (192679us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789175684.786975:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1789175684.803407:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.803433:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.803458:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.803620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175684.804447:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175684.804536:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188096 00000100:00100000:1.0:1789175684.804547:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188096 00000100:00100000:1.0:1789175684.804622:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188352 00000100:00100000:1.0:1789175684.804626:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188352 00000100:00100000:1.0:1789175684.804661:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188608 00000100:00100000:1.0:1789175684.804664:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188608 00000100:00100000:1.0:1789175684.804678:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188224 00000100:00100000:1.0:1789175684.804681:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188224 00000100:00100000:1.0:1789175684.804699:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:1.0:1789175684.804709:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+8:2356:x1876086251188096:12345-192.168.201.18@tcp:4:dd.0 00002000:00010000:1.0:1789175684.807716:0:16598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa4a784, atime: 0x6aa4a783, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789175684.807733:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.807768:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=469s v=(0 0) 00010000:00010000:1.0:1789175684.807773:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175684.807779:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.807797:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.808128:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1789175684.808141:0:16599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:2356:x1876086251188352:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:1.0:1789175684.808176:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.808185:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175684.808189:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789175684.808193:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789175684.808224:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.809520:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1789175684.809534:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+10:2356:x1876086251188608:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1789175684.809587:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.809601:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.809604:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789175684.809609:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.809620:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789175684.811864:0:15057:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789175684.811982:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789175684.811998:0:15056:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789175684.812500:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188480 00000100:00100000:1.0:1789175684.812509:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188480 00000100:00100000:2.0:1789175684.814209:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1789175684.814228:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e60365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7bd2b70-0ce4-4e4a-920a-a90831c72597+12:2356:x1876086251188224:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:2.0:1789175684.814281:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.814307:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.814311:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.814319:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.814336:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175684.882679:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1789175684.886612:0:16598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:2.0:1789175684.886622:0:16598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1789175684.886637:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886652:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886662:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886669:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654a800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175684.886674:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886684:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886725:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886733:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fa853f8/0x1112cdeac4c17ce8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.886850:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+18:2356:x1876086251188096:12345-192.168.201.18@tcp:4:dd.0 Request processed in 82135us (83445us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789175684.886861:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1789175684.886899:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1789175684.886925:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+17:2356:x1876086251188480:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:2.0:1789175684.886958:0:16598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886972:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.886976:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789175684.886983:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.886996:0:16598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789175684.937955:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1789175684.938322:0:15058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789175684.938336:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938358:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938365:0:15058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938370:0:15058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e700030800 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.938373:0:15058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938391:0:15058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938407:0:15058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938411:0:15058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028105fea/0x1112cdeac4c17cf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.938496:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b7bd2b70-0ce4-4e4a-920a-a90831c72597+13:2356:x1876086251188608:12345-192.168.201.18@tcp:4:dd.0 Request processed in 128963us (135032us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789175684.938505:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00010000:00010000:3.0:1789175684.938548:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938555:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938559:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938562:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72654b600 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.938564:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938589:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938597:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.938601:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054874de4/0x1112cdeac4c17cef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.938626:0:16599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b7bd2b70-0ce4-4e4a-920a-a90831c72597+11:2356:x1876086251188352:12345-192.168.201.18@tcp:4:dd.0 Request processed in 130491us (135194us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789175684.938630:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00002000:00010000:2.0:1789175684.940552:0:16601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789175684.940648:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940677:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940686:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940693:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5a00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:2.0:1789175684.940698:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940710:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940732:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789175684.940740:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c86fa5/0x1112cdeac4c17cfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789175684.940873:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e60365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b7bd2b70-0ce4-4e4a-920a-a90831c72597+9:2356:x1876086251188224:12345-192.168.201.18@tcp:4:dd.0 Request processed in 126646us (137247us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789175684.940880:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00010000:00010000:3.0:1789175684.966248:0:16598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966274:0:16598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966285:0:16598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966294:0:16598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97e72e1b5e00 already unused, calling callback (ffffffffc16b14f0) 00010000:00010000:3.0:1789175684.966299:0:16598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966331:0:16598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966369:0:16598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789175684.966378:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef088e1/0x1112cdeac4c17d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789175684.966554:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+7:2356:x1876086251188480:12345-192.168.201.18@tcp:4:dd.0 Request processed in 79640us (162102us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789175684.966565:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000001:00080000:1.0:1789175684.966648:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789175685.665611:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789175686.052572:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789175686.055515:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789175686.055566:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274235136:0@lo:400:kworker.0 00000100:00100000:2.0:1789175686.055676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175686.057309:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235136 00000100:00100000:1.0:1789175686.057327:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235136 00000100:00100000:1.0:1789175686.057506:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175686.057520:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274235136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175686.057652:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876086274235136:12345-0@lo:400:kworker.0 Request processed in 135us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175686.057660:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789175686.057726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1876086274235136:0@lo:400:kworker.0 00000100:00080000:2.0:1789175686.059188:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789175686.060002:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789175686.060050:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e72e458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789175686.060167:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175686.060390:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235264 00000100:00100000:2.0:1789175686.060401:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235264 00000100:00100000:2.0:1789175686.060464:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789175686.060475:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274235264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789175686.060526:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789175686.060583:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876086274235264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175686.060590:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789175686.061404:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789175686.061462:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789175686.061470:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97e60365c700, transno 8589934595 00000004:00080000:1.0:1789175686.061481:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789175686.061540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e72e458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1876086274235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789175686.064318:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274235008:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.064472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789175686.065823:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235008 00000100:00100000:1.0:1789175686.065867:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235008 00000100:00100000:1.0:1789175686.065969:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789175686.065982:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:3307:x1876086274235008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789175686.066109:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71fe837c-1812-4075-866f-5d0b367ca590+19:3307:x1876086274235008:12345-0@lo:400:kworker.0 Request processed in 130us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175686.066118:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789175686.067435:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71fe837c-1812-4075-866f-5d0b367ca590:3307:1876086274235008:0@lo:400:kworker.0 00000100:00100000:2.0:1789175686.071777:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274235392:0@lo:400:kworker.0 00000100:00100000:2.0:1789175686.071902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789175686.072214:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235392 00000100:00100000:0.0:1789175686.072226:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235392 00000100:00100000:0.0:1789175686.072305:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789175686.072318:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274235392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789175686.072440:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876086274235392:12345-0@lo:400:kworker.0 Request processed in 124us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175686.072448:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789175686.072765:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876086274235392:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.073220:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274235648:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.073278:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175686.073318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789175686.073325:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274235520:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.073391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789175686.073814:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235648 00000100:00100000:2.0:1789175686.073822:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235648 00000100:00100000:2.0:1789175686.073884:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235520 00000100:00100000:2.0:1789175686.073899:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235520 00000100:00100000:2.0:1789175686.073930:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789175686.073940:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274235648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175686.074137:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876086274235648:12345-0@lo:400:kworker.0 Request processed in 197us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175686.074145:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789175686.074163:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789175686.074170:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274235520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789175686.074193:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876086274235520:12345-0@lo:400:kworker.0 Request processed in 25us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175686.074197:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789175686.074481:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789175686.074513:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1876086274235520:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.074632:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1876086274235648:0@lo:400:kworker.0 00000100:00100000:3.0:1789175686.562416:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97e602d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274235776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789175686.562514:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789175686.569311:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086274235776 00000100:00100000:3.0:1789175686.569335:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086274235776 00000100:00100000:3.0:1789175686.569435:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789175686.569447:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e737cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274235776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789175686.569500:0:15055:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789175686.569627:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e737cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876086274235776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789175686.569636:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789175686.569849:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97e602d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1876086274235776:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789175686.662978:0:16639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789175686.689534:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789175687.720960:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789175687.810512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175687.813371:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188736 00000100:00100000:1.0:1789175687.813389:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188736 00000100:00100000:0.0:1789175687.814121:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:0.0:1789175687.814136:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72f2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2353:x1876086251188736:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175687.814234:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72f2f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a85c3d9-8b76-4448-9474-6fdc286de2f5+13:2353:x1876086251188736:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 101us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175687.814242:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:1.0:1789175687.814427:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1789175687.815550:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188864 00000100:00100000:2.0:1789175687.816409:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188864 00000100:00100000:2.0:1789175687.816571:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1789175687.816584:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e72e458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:2353:x1876086251188864:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:3.0:1789175687.816684:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789175687.816685:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e72e458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b7bd2b70-0ce4-4e4a-920a-a90831c72597+20:2353:x1876086251188864:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 105us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789175687.816693:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:0.0:1789175687.821559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175687.821720:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175687.821811:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175687.821963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1789175687.821986:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251188992 00000100:00100000:1.0:1789175687.822008:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251188992 00000100:00100000:1.0:1789175687.822093:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251189120 00000100:00100000:1.0:1789175687.822097:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251189120 00000100:00100000:1.0:1789175687.822132:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1789175687.822147:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251188992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175687.822240:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251188992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 96us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175687.822249:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1789175687.822269:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1789175687.822275:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251189120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175687.822300:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b7bd2b70-0ce4-4e4a-920a-a90831c72597+5:2354:x1876086251189120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175687.822307:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00080000:3.0:1789175687.823753:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175687.823764:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789175687.825299:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1789175687.825366:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251189248 00000100:00100000:0.0:1789175687.825377:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251189248 00000100:00100000:0.0:1789175687.825452:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1789175687.825464:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2354:x1876086251189248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1789175687.825566:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2aabdb8c-432a-4341-b40b-231e660be0f4+6:2354:x1876086251189248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 103us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789175687.825574:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00080000:3.0:1789175687.825778:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789175687.825974:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251189376 00000100:00100000:1.0:1789175687.825991:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251189376 00000100:00100000:1.0:1789175687.826174:0:16244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086251189504 00000100:00100000:1.0:1789175687.826179:0:16244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086251189504 00000100:00100000:1.0:1789175687.826205:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1789175687.826212:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251189376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175687.826256:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251189376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 44us (4420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175687.826264:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1789175687.826277:0:16244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1789175687.826284:0:16244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251189504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1789175687.826308:0:16244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97e602d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2aabdb8c-432a-4341-b40b-231e660be0f4+5:2354:x1876086251189504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789175687.826314:0:16244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00080000:3.0:1789175687.826706:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789175687.826710:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 29115 lines, 29115 kept, 0 dropped, 0 bad.